2024-09-17T03:59:33.859 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T03:59:33.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:59:33.976 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries} email: pdonnell@redhat.com first_in_suite: false job_id: '7908504' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnGcytejRrCoVnACiz67mXHSx2oWLNSi80riJUDSXSmfHehf897ZD0+gRSKbyTKqFWYFo7xU0t5iy+HSYhPCF4= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMTkULi5TKs72rsGfJ0lyk9X7GQC07HnczSQLhKslWNd7l1t+4Yi3Idald7OIrgj8+0wEvr4TKtHyQqWX6CKSAY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: client.0: - fs/maxentries teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T03:59:33.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T03:59:33.977 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T03:59:33.977 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T03:59:33.978 INFO:teuthology.task.internal:Checking packages... 2024-09-17T03:59:34.004 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T03:59:34.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T03:59:34.004 INFO:teuthology.packaging:ref: None 2024-09-17T03:59:34.004 INFO:teuthology.packaging:tag: None 2024-09-17T03:59:34.004 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:59:34.004 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:59:34.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:59:34.150 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T03:59:34.152 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T03:59:34.160 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T03:59:34.160 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T03:59:34.182 INFO:teuthology.task.internal:Saving configuration 2024-09-17T03:59:34.200 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T03:59:34.209 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T03:59:34.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:54:34.050148', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnGcytejRrCoVnACiz67mXHSx2oWLNSi80riJUDSXSmfHehf897ZD0+gRSKbyTKqFWYFo7xU0t5iy+HSYhPCF4='} 2024-09-17T03:59:34.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:54:34.052097', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMTkULi5TKs72rsGfJ0lyk9X7GQC07HnczSQLhKslWNd7l1t+4Yi3Idald7OIrgj8+0wEvr4TKtHyQqWX6CKSAY='} 2024-09-17T03:59:34.258 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T03:59:34.269 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T03:59:34.269 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T03:59:34.269 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T03:59:34.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff39615fac0>, signals=[15]) 2024-09-17T03:59:34.341 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T03:59:34.351 INFO:teuthology.task.internal:Opening connections... 2024-09-17T03:59:34.352 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:59:34.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:59:34.429 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:59:34.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:59:34.515 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T03:59:34.523 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-09-17T03:59:34.541 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-09-17T03:59:34.541 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-09-17T03:59:34.599 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-09-17T03:59:34.599 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-09-17T03:59:34.599 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-09-17T03:59:34.599 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:59:34.600 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:59:34.601 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-09-17T03:59:34.627 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-17T03:59:34.646 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-17T03:59:34.646 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:59:34.705 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:59:34.706 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:59:34.706 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-17T03:59:34.727 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T03:59:34.740 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T03:59:34.817 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T03:59:34.817 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:59:34.820 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:59:34.838 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T03:59:34.852 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T03:59:34.853 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:59:34.879 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:59:34.967 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T03:59:35.023 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T03:59:35.040 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T03:59:35.040 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T03:59:35.040 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T03:59:35.040 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:59:35.041 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:59:35.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:59:35.058 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-17T03:59:35.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:59:35.059 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-17T03:59:35.116 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:59:35.116 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-503.el9.x86_64 2024-09-17T03:59:35.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-09-17T03:59:35.117 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:59:35.117 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-503.el9.x86_64 2024-09-17T03:59:35.118 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-09-17T03:59:38.459 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-17T03:59:40.443 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-17T03:59:41.546 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.3 MB 00:04 2024-09-17T03:59:44.733 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-17T03:59:46.409 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T03:59:47.663 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-17T03:59:53.002 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-17T03:59:54.967 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T03:59:54.967 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T03:59:55.056 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T03:59:55.067 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 79 M 2024-09-17T03:59:55.068 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 126 M 2024-09-17T03:59:55.069 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-17T03:59:55.390 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.390 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.390 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.463 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.471 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.478 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.554 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 174 kB/s | 36 kB 00:00 2024-09-17T03:59:55.575 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.597 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:59:55.921 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-17T03:59:56.313 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-17T03:59:57.113 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-17T03:59:57.116 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:59:57.117 INFO:teuthology.orchestra.run.smithi192.stdout:Total 38 MB/s | 79 MB 00:02 2024-09-17T03:59:57.800 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-17T03:59:58.164 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-17T03:59:58.164 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-17T03:59:59.101 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-17T03:59:59.101 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-17T04:00:01.529 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-17T04:00:01.921 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-17T04:00:02.182 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:00:02.265 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:00:05.026 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:00:05.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:00:07.936 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-17T04:00:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-17T04:00:10.007 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:00:10.112 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:10.857 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T04:00:14.936 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:16.245 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-17T04:00:18.193 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:00:18.194 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:00:18.301 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:00:18.307 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 79 M 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 126 M 2024-09-17T04:00:18.308 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-17T04:00:18.522 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 454 kB/s | 36 kB 00:00 2024-09-17T04:00:19.364 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-17T04:00:19.856 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-17T04:00:20.381 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-17T04:00:20.381 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:00:20.381 INFO:teuthology.orchestra.run.smithi104.stdout:Total 38 MB/s | 79 MB 00:02 2024-09-17T04:00:21.065 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-17T04:00:21.424 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-17T04:00:21.424 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-17T04:00:22.406 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-17T04:00:22.407 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-17T04:00:24.845 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-17T04:00:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:00:25.597 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:00:28.354 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:00:28.482 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:00:33.312 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:00:33.407 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:38.258 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:52.620 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:52.660 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:52.953 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:52.953 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:00:52.954 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:00:52.954 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:00:53.806 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-17T04:00:54.167 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:00:54.253 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:00:54.254 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:00:54.254 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:00:54.254 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:00:54.254 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:00:54.254 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T04:00:54.254 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:00:54.254 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:00:54.313 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:00:54.314 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:00:54.314 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-17T04:00:54.346 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-17T04:00:54.347 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:00:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:00:54.349 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:00:54.349 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:00:54.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:00:54.962 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-17T04:00:56.282 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:00:56.314 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-17T04:00:56.316 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T04:00:56.331 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.LSbtjLUSEx 2024-09-17T04:00:56.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LSbtjLUSEx 2024-09-17T04:00:56.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.LSbtjLUSEx 2024-09-17T04:00:56.540 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.LSbtjLUSEx is 6KB 2024-09-17T04:00:56.591 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.LSbtjLUSEx 2024-09-17T04:00:56.606 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:00:56.678 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:00:56.678 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:00:56.678 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:00:56.678 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:00:56.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:00:56.840 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-17T04:01:16.498 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:16.538 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:16.844 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:01:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:01:16.845 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:01:17.705 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:01:17.706 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:01:17.706 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-17T04:01:18.071 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:01:18.155 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:01:18.155 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:01:18.155 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:01:18.155 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:01:18.156 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:01:18.156 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T04:01:18.156 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:01:18.156 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:01:18.215 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:01:18.216 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:01:18.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 82.el9 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8274670 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:01:18.252 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-09-17T04:01:18.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:01:18.254 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:01:18.254 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:01:18.254 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:01:18.255 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:01:18.951 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-09-17T04:01:20.276 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:01:20.305 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-09-17T04:01:20.309 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-17T04:01:20.325 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.RqwaX7OJXh 2024-09-17T04:01:20.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RqwaX7OJXh 2024-09-17T04:01:20.392 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.RqwaX7OJXh 2024-09-17T04:01:20.535 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.RqwaX7OJXh is 6KB 2024-09-17T04:01:20.583 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.RqwaX7OJXh 2024-09-17T04:01:20.598 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:01:20.661 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:01:20.661 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:01:20.661 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:01:20.661 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:01:20.663 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:01:20.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-09-17T04:01:26.849 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T04:01:26.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:01:26.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:01:45.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T04:01:50.836 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T04:01:50.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:01:50.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:01:54.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:01:54.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:01:57.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T04:02:09.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:02:09.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:09.348 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T04:02:18.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:02:18.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:21.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T04:02:27.776 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T04:02:33.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:02:33.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:42.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:02:42.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:02:43.041 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-17T04:02:43.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:02:43.432 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:02:43.432 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-17T04:02:43.447 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:02:43.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:02:43.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:02:43.447 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:02:44.448 DEBUG:teuthology.parallel:result is None 2024-09-17T04:02:51.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T04:03:06.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:03:06.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:03:07.148 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-17T04:03:07.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:03:07.554 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:03:07.554 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-17T04:03:07.569 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:03:07.569 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:03:07.569 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:03:07.569 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:03:08.570 DEBUG:teuthology.parallel:result is None 2024-09-17T04:03:08.571 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T04:03:08.577 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T04:03:08.578 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:03:08.581 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:03:08.600 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T04:03:08.607 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T04:03:08.617 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T04:03:08.617 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:03:08.637 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:03:08.675 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T04:03:08.681 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T04:03:08.681 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:03:08.701 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:03:08.794 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:03:08.830 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:03:08.845 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:03:08.849 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:03:08.851 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T04:03:08.858 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T04:03:08.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:03:08.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:03:08.889 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T04:03:08.898 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T04:03:08.898 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:03:08.925 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:03:08.947 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:03:09.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:03:09.103 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:03:09.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:03:09.184 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:03:09.184 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:03:09.253 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:03:09.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:03:09.351 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:03:09.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:03:09.478 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:03:09.478 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:03:09.544 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-09-17T04:03:09.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-17T04:03:09.623 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:03:09.638 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:03:10.146 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T04:03:10.154 INFO:teuthology.task.internal:Starting timer... 2024-09-17T04:03:10.154 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T04:03:10.165 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T04:03:10.174 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-09-17T04:03:10.252 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-09-17T04:03:10.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-17T04:03:10.326 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-17T04:03:10.329 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T04:03:10.330 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-09-17T04:03:10.348 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-09-17T04:03:10.349 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-17T04:03:10.370 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-17T04:03:10.371 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-17T04:03:10.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:03:10.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:03:10.416 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:03:10.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:03:10.444 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T04:03:10.444 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:03:10.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:03:10.517 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T04:03:10.527 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T04:03:10.538 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T04:03:10.539 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T04:06:57.196 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-17T04:06:57.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:06:57.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:06:57.275 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-17T04:06:57.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T04:06:57.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:06:57.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:06:57.392 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-17T04:06:57.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T04:06:57.476 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T04:06:57.487 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T04:06:57.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:06:57.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:06:57.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:06:57.490 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:06:57.519 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:06:57.534 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:06:57.544 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:06:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:06:57.559 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-09-17T04:06:57.570 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-09-17T04:06:57.583 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-17T04:06:57.584 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:06:57.594 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-17T04:06:57.599 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:06:57.609 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:06:57.623 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:06:57.661 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:06:57.663 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:06:57.663 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-17T04:06:57.664 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.664 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.664 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.664 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:06:57.681 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:06:57.682 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-17T04:06:57.682 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.682 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.682 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.682 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:06:57.683 INFO:teuthology.run_tasks:Running task install... 2024-09-17T04:06:57.690 DEBUG:teuthology.task.install:project ceph 2024-09-17T04:06:57.691 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T04:06:57.691 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T04:06:57.691 INFO:teuthology.task.install:Using flavor: default 2024-09-17T04:06:57.696 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T04:06:57.697 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T04:06:57.697 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:06:57.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:06:57.700 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:06:57.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:06:57.843 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:06:57.843 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:06:57.847 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:06:57.847 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:06:57.960 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:06:57.960 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:06:57.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:06:57.964 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:06:57.964 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:06:57.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:06:57.986 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:06:57.986 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:06:57.994 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:06:57.994 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:06:58.053 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:06:58.059 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:06:58.129 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:06:58.133 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:06:58.193 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-09-17T04:06:58.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-09-17T04:06:58.198 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-17T04:06:58.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-17T04:06:58.423 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-17T04:06:58.429 INFO:teuthology.orchestra.run.smithi104.stdout:45 files removed 2024-09-17T04:06:58.450 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:06:58.455 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:06:58.998 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-17T04:06:59.008 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-17T04:06:59.293 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-17T04:06:59.298 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T04:06:59.577 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-17T04:06:59.582 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T04:07:00.537 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.3 MB 00:00 2024-09-17T04:07:01.390 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-17T04:07:03.400 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-17T04:07:03.411 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-17T04:07:07.662 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-17T04:07:09.129 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-17T04:07:09.370 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-17T04:07:10.108 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-17T04:07:11.385 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-17T04:07:12.430 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-17T04:07:15.533 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-17T04:07:17.720 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:07:17.721 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:07:17.734 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:07:17.735 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:07:17.736 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:07:17.737 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:07:17.739 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:07:17.742 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:07:17.743 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:07:17.761 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T04:07:17.807 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:07:17.827 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:07:17.828 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:07:17.829 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:07:17.830 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:07:17.831 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:07:17.832 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:07:17.833 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:07:17.834 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:07:17.835 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:07:17.836 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:07:17.837 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:07:17.838 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:07:17.839 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:Install 149 Packages 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 8 Packages 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 228 M 2024-09-17T04:07:17.840 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-17T04:07:18.858 INFO:teuthology.orchestra.run.smithi104.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-17T04:07:19.050 INFO:teuthology.orchestra.run.smithi104.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.5 MB/s | 873 kB 00:00 2024-09-17T04:07:19.134 INFO:teuthology.orchestra.run.smithi104.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.7 MB/s | 148 kB 00:00 2024-09-17T04:07:19.201 INFO:teuthology.orchestra.run.smithi104.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-17T04:07:19.309 INFO:teuthology.orchestra.run.smithi104.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 14 MB/s | 1.5 MB 00:00 2024-09-17T04:07:19.360 INFO:teuthology.orchestra.run.smithi104.stdout:(6/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 10 MB/s | 2.3 MB 00:00 2024-09-17T04:07:19.543 INFO:teuthology.orchestra.run.smithi104.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-17T04:07:19.960 INFO:teuthology.orchestra.run.smithi104.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 16 MB/s | 20 MB 00:01 2024-09-17T04:07:19.965 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:07:19.966 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:07:19.979 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:07:19.980 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:07:19.981 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:07:19.982 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:07:19.984 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:07:19.987 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:07:19.988 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:07:20.010 INFO:teuthology.orchestra.run.smithi104.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 508 kB/s | 25 kB 00:00 2024-09-17T04:07:20.050 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:07:20.070 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:07:20.071 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:07:20.072 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:07:20.073 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:07:20.074 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:07:20.075 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:07:20.076 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:07:20.077 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:07:20.078 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:07:20.079 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:07:20.080 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:07:20.081 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:07:20.082 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout:Install 149 Packages 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-17T04:07:20.083 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:07:20.084 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 228 M 2024-09-17T04:07:20.084 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-17T04:07:20.186 INFO:teuthology.orchestra.run.smithi104.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 16 MB/s | 10 MB 00:00 2024-09-17T04:07:20.244 INFO:teuthology.orchestra.run.smithi104.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 3.8 MB/s | 225 kB 00:00 2024-09-17T04:07:20.311 INFO:teuthology.orchestra.run.smithi104.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 406 kB/s | 27 kB 00:00 2024-09-17T04:07:20.378 INFO:teuthology.orchestra.run.smithi104.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 477 kB/s | 32 kB 00:00 2024-09-17T04:07:20.478 INFO:teuthology.orchestra.run.smithi104.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 7.5 MB/s | 766 kB 00:00 2024-09-17T04:07:20.521 INFO:teuthology.orchestra.run.smithi192.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-09-17T04:07:20.662 INFO:teuthology.orchestra.run.smithi104.stdout:(15/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 14 MB/s | 18 MB 00:01 2024-09-17T04:07:20.687 INFO:teuthology.orchestra.run.smithi104.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 762 kB/s | 159 kB 00:00 2024-09-17T04:07:20.712 INFO:teuthology.orchestra.run.smithi104.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T04:07:20.754 INFO:teuthology.orchestra.run.smithi104.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 7.4 MB/s | 507 kB 00:00 2024-09-17T04:07:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 680 kB/s | 45 kB 00:00 2024-09-17T04:07:20.821 INFO:teuthology.orchestra.run.smithi192.stdout:(2/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-17T04:07:20.897 INFO:teuthology.orchestra.run.smithi104.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.9 MB/s | 143 kB 00:00 2024-09-17T04:07:20.897 INFO:teuthology.orchestra.run.smithi192.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.9 MB/s | 148 kB 00:00 2024-09-17T04:07:20.972 INFO:teuthology.orchestra.run.smithi104.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 2.1 MB/s | 162 kB 00:00 2024-09-17T04:07:21.014 INFO:teuthology.orchestra.run.smithi192.stdout:(4/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 873 kB 00:00 2024-09-17T04:07:21.063 INFO:teuthology.orchestra.run.smithi104.stdout:(22/157): python3-rados-19.3.0-4989.gce1b342b.e 3.4 MB/s | 321 kB 00:00 2024-09-17T04:07:21.081 INFO:teuthology.orchestra.run.smithi192.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 2.3 MB 00:00 2024-09-17T04:07:21.147 INFO:teuthology.orchestra.run.smithi104.stdout:(23/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-17T04:07:21.172 INFO:teuthology.orchestra.run.smithi104.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 2.7 MB/s | 305 kB 00:00 2024-09-17T04:07:21.231 INFO:teuthology.orchestra.run.smithi104.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T04:07:21.257 INFO:teuthology.orchestra.run.smithi104.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-17T04:07:21.331 INFO:teuthology.orchestra.run.smithi192.stdout:(6/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 20 MB/s | 5.0 MB 00:00 2024-09-17T04:07:21.332 INFO:teuthology.orchestra.run.smithi104.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-17T04:07:21.449 INFO:teuthology.orchestra.run.smithi104.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 294 kB/s | 34 kB 00:00 2024-09-17T04:07:21.549 INFO:teuthology.orchestra.run.smithi104.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 1.5 MB/s | 154 kB 00:00 2024-09-17T04:07:21.665 INFO:teuthology.orchestra.run.smithi192.stdout:(7/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 2.3 MB/s | 1.5 MB 00:00 2024-09-17T04:07:21.916 INFO:teuthology.orchestra.run.smithi104.stdout:(30/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 21 MB/s | 40 MB 00:01 2024-09-17T04:07:21.974 INFO:teuthology.orchestra.run.smithi104.stdout:(31/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 4.2 MB/s | 3.1 MB 00:00 2024-09-17T04:07:22.041 INFO:teuthology.orchestra.run.smithi104.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T04:07:22.100 INFO:teuthology.orchestra.run.smithi104.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 849 kB/s | 49 kB 00:00 2024-09-17T04:07:22.114 INFO:teuthology.orchestra.run.smithi192.stdout:(8/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x86 23 MB/s | 18 MB 00:00 2024-09-17T04:07:22.167 INFO:teuthology.orchestra.run.smithi104.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 247 kB/s | 16 kB 00:00 2024-09-17T04:07:22.181 INFO:teuthology.orchestra.run.smithi192.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 378 kB/s | 25 kB 00:00 2024-09-17T04:07:22.242 INFO:teuthology.orchestra.run.smithi104.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 3.7 MB/s | 285 kB 00:00 2024-09-17T04:07:22.326 INFO:teuthology.orchestra.run.smithi104.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-17T04:07:22.401 INFO:teuthology.orchestra.run.smithi104.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 4.8 MB/s | 784 kB 00:00 2024-09-17T04:07:22.426 INFO:teuthology.orchestra.run.smithi104.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 182 kB/s | 18 kB 00:00 2024-09-17T04:07:22.568 INFO:teuthology.orchestra.run.smithi104.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-17T04:07:22.728 INFO:teuthology.orchestra.run.smithi104.stdout:(40/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 12 MB/s | 14 MB 00:01 2024-09-17T04:07:22.752 INFO:teuthology.orchestra.run.smithi104.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-17T04:07:22.811 INFO:teuthology.orchestra.run.smithi104.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-17T04:07:22.869 INFO:teuthology.orchestra.run.smithi104.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T04:07:22.911 INFO:teuthology.orchestra.run.smithi104.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-17T04:07:22.923 INFO:teuthology.orchestra.run.smithi192.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 8.3 MB/s | 10 MB 00:01 2024-09-17T04:07:22.928 INFO:teuthology.orchestra.run.smithi104.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-17T04:07:22.953 INFO:teuthology.orchestra.run.smithi104.stdout:(46/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-17T04:07:22.982 INFO:teuthology.orchestra.run.smithi192.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 3.8 MB/s | 225 kB 00:00 2024-09-17T04:07:22.987 INFO:teuthology.orchestra.run.smithi104.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T04:07:23.013 INFO:teuthology.orchestra.run.smithi104.stdout:(48/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-17T04:07:23.041 INFO:teuthology.orchestra.run.smithi192.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 464 kB/s | 27 kB 00:00 2024-09-17T04:07:23.107 INFO:teuthology.orchestra.run.smithi192.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 477 kB/s | 32 kB 00:00 2024-09-17T04:07:23.162 INFO:teuthology.orchestra.run.smithi104.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 713 kB/s | 107 kB 00:00 2024-09-17T04:07:23.187 INFO:teuthology.orchestra.run.smithi104.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-17T04:07:23.213 INFO:teuthology.orchestra.run.smithi104.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-17T04:07:23.255 INFO:teuthology.orchestra.run.smithi104.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-17T04:07:23.280 INFO:teuthology.orchestra.run.smithi104.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-17T04:07:23.305 INFO:teuthology.orchestra.run.smithi104.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-17T04:07:23.331 INFO:teuthology.orchestra.run.smithi104.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 360 kB/s | 18 kB 00:00 2024-09-17T04:07:23.356 INFO:teuthology.orchestra.run.smithi104.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-17T04:07:23.366 INFO:teuthology.orchestra.run.smithi192.stdout:(14/157): ceph-common-19.3.0-4989.gce1b342b.el9 6.6 MB/s | 20 MB 00:03 2024-09-17T04:07:23.381 INFO:teuthology.orchestra.run.smithi104.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-17T04:07:23.400 INFO:teuthology.orchestra.run.smithi192.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 2.6 MB/s | 766 kB 00:00 2024-09-17T04:07:23.425 INFO:teuthology.orchestra.run.smithi192.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.7 MB/s | 159 kB 00:00 2024-09-17T04:07:23.440 INFO:teuthology.orchestra.run.smithi104.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-17T04:07:23.450 INFO:teuthology.orchestra.run.smithi192.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T04:07:23.465 INFO:teuthology.orchestra.run.smithi104.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-09-17T04:07:23.475 INFO:teuthology.orchestra.run.smithi192.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 9.9 MB/s | 507 kB 00:00 2024-09-17T04:07:23.499 INFO:teuthology.orchestra.run.smithi104.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-17T04:07:23.526 INFO:teuthology.orchestra.run.smithi192.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 903 kB/s | 45 kB 00:00 2024-09-17T04:07:23.532 INFO:teuthology.orchestra.run.smithi104.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-17T04:07:23.557 INFO:teuthology.orchestra.run.smithi104.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-17T04:07:23.583 INFO:teuthology.orchestra.run.smithi104.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-17T04:07:23.593 INFO:teuthology.orchestra.run.smithi192.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.1 MB/s | 143 kB 00:00 2024-09-17T04:07:23.608 INFO:teuthology.orchestra.run.smithi104.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-17T04:07:23.633 INFO:teuthology.orchestra.run.smithi104.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-17T04:07:23.658 INFO:teuthology.orchestra.run.smithi104.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-17T04:07:23.676 INFO:teuthology.orchestra.run.smithi192.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.9 MB/s | 162 kB 00:00 2024-09-17T04:07:23.692 INFO:teuthology.orchestra.run.smithi104.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-17T04:07:23.768 INFO:teuthology.orchestra.run.smithi192.stdout:(22/157): python3-rados-19.3.0-4989.gce1b342b.e 3.4 MB/s | 321 kB 00:00 2024-09-17T04:07:23.784 INFO:teuthology.orchestra.run.smithi104.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-17T04:07:23.844 INFO:teuthology.orchestra.run.smithi192.stdout:(23/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-17T04:07:23.851 INFO:teuthology.orchestra.run.smithi104.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-17T04:07:23.869 INFO:teuthology.orchestra.run.smithi192.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 3.0 MB/s | 305 kB 00:00 2024-09-17T04:07:23.884 INFO:teuthology.orchestra.run.smithi104.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-17T04:07:23.894 INFO:teuthology.orchestra.run.smithi192.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T04:07:23.910 INFO:teuthology.orchestra.run.smithi104.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T04:07:23.919 INFO:teuthology.orchestra.run.smithi192.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T04:07:23.952 INFO:teuthology.orchestra.run.smithi104.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-17T04:07:23.970 INFO:teuthology.orchestra.run.smithi192.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T04:07:23.994 INFO:teuthology.orchestra.run.smithi104.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-17T04:07:24.019 INFO:teuthology.orchestra.run.smithi104.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T04:07:24.061 INFO:teuthology.orchestra.run.smithi104.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-17T04:07:24.136 INFO:teuthology.orchestra.run.smithi104.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-17T04:07:24.161 INFO:teuthology.orchestra.run.smithi104.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-17T04:07:24.186 INFO:teuthology.orchestra.run.smithi104.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-17T04:07:24.212 INFO:teuthology.orchestra.run.smithi104.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-17T04:07:24.237 INFO:teuthology.orchestra.run.smithi104.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-17T04:07:24.262 INFO:teuthology.orchestra.run.smithi104.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-17T04:07:24.287 INFO:teuthology.orchestra.run.smithi104.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-17T04:07:24.329 INFO:teuthology.orchestra.run.smithi192.stdout:(28/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 19 MB/s | 40 MB 00:02 2024-09-17T04:07:24.354 INFO:teuthology.orchestra.run.smithi192.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 89 kB/s | 34 kB 00:00 2024-09-17T04:07:24.362 INFO:teuthology.orchestra.run.smithi104.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-17T04:07:24.379 INFO:teuthology.orchestra.run.smithi192.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T04:07:24.388 INFO:teuthology.orchestra.run.smithi104.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-17T04:07:24.413 INFO:teuthology.orchestra.run.smithi104.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-17T04:07:24.437 INFO:teuthology.orchestra.run.smithi192.stdout:(31/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 5.7 MB/s | 3.1 MB 00:00 2024-09-17T04:07:24.438 INFO:teuthology.orchestra.run.smithi104.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T04:07:24.464 INFO:teuthology.orchestra.run.smithi104.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-17T04:07:24.489 INFO:teuthology.orchestra.run.smithi104.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T04:07:24.514 INFO:teuthology.orchestra.run.smithi104.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T04:07:24.540 INFO:teuthology.orchestra.run.smithi104.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T04:07:24.546 INFO:teuthology.orchestra.run.smithi192.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 2.6 MB/s | 291 kB 00:00 2024-09-17T04:07:24.556 INFO:teuthology.orchestra.run.smithi104.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-17T04:07:24.573 INFO:teuthology.orchestra.run.smithi104.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-17T04:07:24.613 INFO:teuthology.orchestra.run.smithi192.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 744 kB/s | 49 kB 00:00 2024-09-17T04:07:24.649 INFO:teuthology.orchestra.run.smithi104.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-17T04:07:24.674 INFO:teuthology.orchestra.run.smithi104.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-17T04:07:24.680 INFO:teuthology.orchestra.run.smithi192.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 247 kB/s | 16 kB 00:00 2024-09-17T04:07:24.699 INFO:teuthology.orchestra.run.smithi104.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-17T04:07:24.725 INFO:teuthology.orchestra.run.smithi104.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T04:07:24.750 INFO:teuthology.orchestra.run.smithi104.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-17T04:07:24.772 INFO:teuthology.orchestra.run.smithi192.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 19 MB/s | 7.4 MB 00:00 2024-09-17T04:07:24.775 INFO:teuthology.orchestra.run.smithi104.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-17T04:07:24.797 INFO:teuthology.orchestra.run.smithi192.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 2.4 MB/s | 285 kB 00:00 2024-09-17T04:07:24.800 INFO:teuthology.orchestra.run.smithi104.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T04:07:24.826 INFO:teuthology.orchestra.run.smithi104.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T04:07:24.839 INFO:teuthology.orchestra.run.smithi192.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 11 MB/s | 784 kB 00:00 2024-09-17T04:07:24.851 INFO:teuthology.orchestra.run.smithi104.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T04:07:24.864 INFO:teuthology.orchestra.run.smithi192.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 273 kB/s | 18 kB 00:00 2024-09-17T04:07:24.876 INFO:teuthology.orchestra.run.smithi104.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T04:07:24.901 INFO:teuthology.orchestra.run.smithi104.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-17T04:07:24.977 INFO:teuthology.orchestra.run.smithi104.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-17T04:07:25.027 INFO:teuthology.orchestra.run.smithi104.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-17T04:07:25.031 INFO:teuthology.orchestra.run.smithi192.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 21 MB/s | 14 MB 00:00 2024-09-17T04:07:25.060 INFO:teuthology.orchestra.run.smithi104.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T04:07:25.065 INFO:teuthology.orchestra.run.smithi192.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 355 kB/s | 80 kB 00:00 2024-09-17T04:07:25.086 INFO:teuthology.orchestra.run.smithi104.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-17T04:07:25.157 INFO:teuthology.orchestra.run.smithi192.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-17T04:07:25.182 INFO:teuthology.orchestra.run.smithi192.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-17T04:07:25.203 INFO:teuthology.orchestra.run.smithi104.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-17T04:07:25.224 INFO:teuthology.orchestra.run.smithi192.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 996 kB/s | 191 kB 00:00 2024-09-17T04:07:25.228 INFO:teuthology.orchestra.run.smithi104.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T04:07:25.253 INFO:teuthology.orchestra.run.smithi104.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T04:07:25.258 INFO:teuthology.orchestra.run.smithi192.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-17T04:07:25.295 INFO:teuthology.orchestra.run.smithi104.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-17T04:07:25.299 INFO:teuthology.orchestra.run.smithi192.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-17T04:07:25.329 INFO:teuthology.orchestra.run.smithi104.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 895 kB/s | 67 kB 00:00 2024-09-17T04:07:25.333 INFO:teuthology.orchestra.run.smithi192.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-17T04:07:25.358 INFO:teuthology.orchestra.run.smithi192.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-17T04:07:25.387 INFO:teuthology.orchestra.run.smithi104.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-17T04:07:25.392 INFO:teuthology.orchestra.run.smithi192.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-17T04:07:25.421 INFO:teuthology.orchestra.run.smithi104.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-17T04:07:25.446 INFO:teuthology.orchestra.run.smithi104.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T04:07:25.471 INFO:teuthology.orchestra.run.smithi104.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T04:07:25.492 INFO:teuthology.orchestra.run.smithi192.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-17T04:07:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-17T04:07:25.522 INFO:teuthology.orchestra.run.smithi104.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-17T04:07:25.525 INFO:teuthology.orchestra.run.smithi192.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-17T04:07:25.547 INFO:teuthology.orchestra.run.smithi104.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T04:07:25.551 INFO:teuthology.orchestra.run.smithi192.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-17T04:07:25.581 INFO:teuthology.orchestra.run.smithi104.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-17T04:07:25.593 INFO:teuthology.orchestra.run.smithi192.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-17T04:07:25.607 INFO:teuthology.orchestra.run.smithi104.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T04:07:25.618 INFO:teuthology.orchestra.run.smithi192.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-17T04:07:25.631 INFO:teuthology.orchestra.run.smithi104.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T04:07:25.643 INFO:teuthology.orchestra.run.smithi192.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-17T04:07:25.665 INFO:teuthology.orchestra.run.smithi104.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T04:07:25.677 INFO:teuthology.orchestra.run.smithi192.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-17T04:07:25.690 INFO:teuthology.orchestra.run.smithi104.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-17T04:07:25.702 INFO:teuthology.orchestra.run.smithi192.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-17T04:07:25.716 INFO:teuthology.orchestra.run.smithi104.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-17T04:07:25.742 INFO:teuthology.orchestra.run.smithi104.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-17T04:07:25.744 INFO:teuthology.orchestra.run.smithi192.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-17T04:07:25.766 INFO:teuthology.orchestra.run.smithi104.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-17T04:07:25.792 INFO:teuthology.orchestra.run.smithi104.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-17T04:07:25.803 INFO:teuthology.orchestra.run.smithi192.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-17T04:07:25.828 INFO:teuthology.orchestra.run.smithi192.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-17T04:07:25.845 INFO:teuthology.orchestra.run.smithi192.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-09-17T04:07:25.879 INFO:teuthology.orchestra.run.smithi192.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-17T04:07:25.896 INFO:teuthology.orchestra.run.smithi192.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-17T04:07:25.913 INFO:teuthology.orchestra.run.smithi192.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-17T04:07:25.942 INFO:teuthology.orchestra.run.smithi104.stdout:(129/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-17T04:07:25.946 INFO:teuthology.orchestra.run.smithi192.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 5.6 MB/s | 581 kB 00:00 2024-09-17T04:07:25.971 INFO:teuthology.orchestra.run.smithi192.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-17T04:07:25.984 INFO:teuthology.orchestra.run.smithi104.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-17T04:07:25.997 INFO:teuthology.orchestra.run.smithi192.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-17T04:07:26.022 INFO:teuthology.orchestra.run.smithi192.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-17T04:07:26.034 INFO:teuthology.orchestra.run.smithi104.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-17T04:07:26.068 INFO:teuthology.orchestra.run.smithi104.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-17T04:07:26.093 INFO:teuthology.orchestra.run.smithi104.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-09-17T04:07:26.110 INFO:teuthology.orchestra.run.smithi104.stdout:(134/157): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-09-17T04:07:26.122 INFO:teuthology.orchestra.run.smithi192.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T04:07:26.126 INFO:teuthology.orchestra.run.smithi104.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 493 kB/s | 16 kB 00:00 2024-09-17T04:07:26.160 INFO:teuthology.orchestra.run.smithi104.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-17T04:07:26.177 INFO:teuthology.orchestra.run.smithi104.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-17T04:07:26.189 INFO:teuthology.orchestra.run.smithi192.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-17T04:07:26.194 INFO:teuthology.orchestra.run.smithi104.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 922 kB/s | 31 kB 00:00 2024-09-17T04:07:26.219 INFO:teuthology.orchestra.run.smithi104.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T04:07:26.223 INFO:teuthology.orchestra.run.smithi192.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-17T04:07:26.236 INFO:teuthology.orchestra.run.smithi104.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-17T04:07:26.248 INFO:teuthology.orchestra.run.smithi192.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T04:07:26.253 INFO:teuthology.orchestra.run.smithi104.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-17T04:07:26.278 INFO:teuthology.orchestra.run.smithi104.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-17T04:07:26.304 INFO:teuthology.orchestra.run.smithi104.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-17T04:07:26.315 INFO:teuthology.orchestra.run.smithi192.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-17T04:07:26.329 INFO:teuthology.orchestra.run.smithi104.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T04:07:26.354 INFO:teuthology.orchestra.run.smithi104.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-17T04:07:26.379 INFO:teuthology.orchestra.run.smithi104.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-17T04:07:26.380 INFO:teuthology.orchestra.run.smithi192.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T04:07:26.405 INFO:teuthology.orchestra.run.smithi104.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T04:07:26.430 INFO:teuthology.orchestra.run.smithi104.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-17T04:07:26.497 INFO:teuthology.orchestra.run.smithi104.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-17T04:07:26.507 INFO:teuthology.orchestra.run.smithi192.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-17T04:07:26.549 INFO:teuthology.orchestra.run.smithi192.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-17T04:07:26.599 INFO:teuthology.orchestra.run.smithi192.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-17T04:07:26.671 INFO:teuthology.orchestra.run.smithi104.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T04:07:26.674 INFO:teuthology.orchestra.run.smithi192.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-17T04:07:26.700 INFO:teuthology.orchestra.run.smithi192.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-17T04:07:26.725 INFO:teuthology.orchestra.run.smithi192.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-17T04:07:26.750 INFO:teuthology.orchestra.run.smithi192.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-17T04:07:26.776 INFO:teuthology.orchestra.run.smithi192.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-17T04:07:26.813 INFO:teuthology.orchestra.run.smithi104.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 8.3 MB/s | 3.2 MB 00:00 2024-09-17T04:07:26.842 INFO:teuthology.orchestra.run.smithi192.stdout:(82/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-09-17T04:07:26.876 INFO:teuthology.orchestra.run.smithi192.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-09-17T04:07:26.926 INFO:teuthology.orchestra.run.smithi192.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-17T04:07:26.951 INFO:teuthology.orchestra.run.smithi192.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-17T04:07:26.955 INFO:teuthology.orchestra.run.smithi104.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.1 MB/s | 2.3 MB 00:00 2024-09-17T04:07:26.977 INFO:teuthology.orchestra.run.smithi192.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T04:07:26.980 INFO:teuthology.orchestra.run.smithi104.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 245 kB/s | 41 kB 00:00 2024-09-17T04:07:27.002 INFO:teuthology.orchestra.run.smithi192.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-17T04:07:27.022 INFO:teuthology.orchestra.run.smithi104.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.2 MB/s | 1.8 MB 00:00 2024-09-17T04:07:27.027 INFO:teuthology.orchestra.run.smithi192.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T04:07:27.052 INFO:teuthology.orchestra.run.smithi192.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T04:07:27.078 INFO:teuthology.orchestra.run.smithi192.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T04:07:27.103 INFO:teuthology.orchestra.run.smithi192.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T04:07:27.129 INFO:teuthology.orchestra.run.smithi192.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T04:07:27.131 INFO:teuthology.orchestra.run.smithi104.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.4 MB/s | 249 kB 00:00 2024-09-17T04:07:27.195 INFO:teuthology.orchestra.run.smithi192.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T04:07:27.221 INFO:teuthology.orchestra.run.smithi192.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-17T04:07:27.246 INFO:teuthology.orchestra.run.smithi192.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-17T04:07:27.256 INFO:teuthology.orchestra.run.smithi104.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 1.4 MB 00:00 2024-09-17T04:07:27.271 INFO:teuthology.orchestra.run.smithi192.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T04:07:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-17T04:07:27.322 INFO:teuthology.orchestra.run.smithi192.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-17T04:07:27.347 INFO:teuthology.orchestra.run.smithi192.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T04:07:27.372 INFO:teuthology.orchestra.run.smithi192.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T04:07:27.398 INFO:teuthology.orchestra.run.smithi192.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T04:07:27.423 INFO:teuthology.orchestra.run.smithi192.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T04:07:27.448 INFO:teuthology.orchestra.run.smithi192.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-17T04:07:27.557 INFO:teuthology.orchestra.run.smithi192.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-17T04:07:27.624 INFO:teuthology.orchestra.run.smithi192.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-17T04:07:27.665 INFO:teuthology.orchestra.run.smithi192.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-17T04:07:27.682 INFO:teuthology.orchestra.run.smithi192.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-17T04:07:27.733 INFO:teuthology.orchestra.run.smithi192.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-17T04:07:27.774 INFO:teuthology.orchestra.run.smithi192.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 628 kB/s | 26 kB 00:00 2024-09-17T04:07:27.800 INFO:teuthology.orchestra.run.smithi192.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T04:07:27.950 INFO:teuthology.orchestra.run.smithi192.stdout:(111/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-17T04:07:27.984 INFO:teuthology.orchestra.run.smithi192.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 367 kB/s | 67 kB 00:00 2024-09-17T04:07:28.059 INFO:teuthology.orchestra.run.smithi192.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-17T04:07:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:(114/157): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-17T04:07:28.109 INFO:teuthology.orchestra.run.smithi192.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T04:07:28.135 INFO:teuthology.orchestra.run.smithi192.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T04:07:28.168 INFO:teuthology.orchestra.run.smithi192.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-17T04:07:28.194 INFO:teuthology.orchestra.run.smithi192.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-17T04:07:28.219 INFO:teuthology.orchestra.run.smithi192.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-09-17T04:07:28.231 INFO:teuthology.orchestra.run.smithi104.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-17T04:07:28.238 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:07:28.238 INFO:teuthology.orchestra.run.smithi104.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-17T04:07:28.244 INFO:teuthology.orchestra.run.smithi192.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-17T04:07:28.278 INFO:teuthology.orchestra.run.smithi192.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T04:07:28.303 INFO:teuthology.orchestra.run.smithi192.stdout:(122/157): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-17T04:07:28.329 INFO:teuthology.orchestra.run.smithi192.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-17T04:07:28.354 INFO:teuthology.orchestra.run.smithi192.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-17T04:07:28.379 INFO:teuthology.orchestra.run.smithi192.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-17T04:07:28.404 INFO:teuthology.orchestra.run.smithi192.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-17T04:07:28.430 INFO:teuthology.orchestra.run.smithi192.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-17T04:07:28.455 INFO:teuthology.orchestra.run.smithi192.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-17T04:07:28.480 INFO:teuthology.orchestra.run.smithi192.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-17T04:07:28.505 INFO:teuthology.orchestra.run.smithi192.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T04:07:28.531 INFO:teuthology.orchestra.run.smithi192.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T04:07:28.556 INFO:teuthology.orchestra.run.smithi192.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T04:07:28.590 INFO:teuthology.orchestra.run.smithi192.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-17T04:07:28.615 INFO:teuthology.orchestra.run.smithi192.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-17T04:07:28.640 INFO:teuthology.orchestra.run.smithi192.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-17T04:07:28.676 INFO:teuthology.orchestra.run.smithi192.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 803 kB/s | 28 kB 00:00 2024-09-17T04:07:28.699 INFO:teuthology.orchestra.run.smithi192.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-17T04:07:28.724 INFO:teuthology.orchestra.run.smithi192.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 634 kB/s | 31 kB 00:00 2024-09-17T04:07:28.750 INFO:teuthology.orchestra.run.smithi192.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T04:07:28.775 INFO:teuthology.orchestra.run.smithi192.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-17T04:07:28.800 INFO:teuthology.orchestra.run.smithi192.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-17T04:07:28.825 INFO:teuthology.orchestra.run.smithi192.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-17T04:07:28.876 INFO:teuthology.orchestra.run.smithi192.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-17T04:07:28.901 INFO:teuthology.orchestra.run.smithi192.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-17T04:07:28.935 INFO:teuthology.orchestra.run.smithi192.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-17T04:07:28.960 INFO:teuthology.orchestra.run.smithi192.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-17T04:07:28.985 INFO:teuthology.orchestra.run.smithi192.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T04:07:29.010 INFO:teuthology.orchestra.run.smithi192.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-17T04:07:29.052 INFO:teuthology.orchestra.run.smithi192.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-17T04:07:29.114 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T04:07:29.236 INFO:teuthology.orchestra.run.smithi192.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 14 MB/s | 3.4 MB 00:00 2024-09-17T04:07:29.236 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T04:07:29.285 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T04:07:29.361 INFO:teuthology.orchestra.run.smithi192.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 9.0 MB/s | 3.2 MB 00:00 2024-09-17T04:07:29.362 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T04:07:29.414 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] NetworkManager-team-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.51.0-1.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T04:07:29.461 INFO:teuthology.orchestra.run.smithi192.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.8 MB/s | 2.3 MB 00:00 2024-09-17T04:07:29.487 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-17T04:07:29.504 INFO:teuthology.orchestra.run.smithi192.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 6.8 MB/s | 1.8 MB 00:00 2024-09-17T04:07:29.529 INFO:teuthology.orchestra.run.smithi192.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 245 kB/s | 41 kB 00:00 2024-09-17T04:07:29.554 INFO:teuthology.orchestra.run.smithi192.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-17T04:07:29.596 INFO:teuthology.orchestra.run.smithi192.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-17T04:07:29.638 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-17T04:07:29.639 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-17T04:07:29.654 INFO:teuthology.orchestra.run.smithi192.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-17T04:07:29.663 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:07:29.663 INFO:teuthology.orchestra.run.smithi192.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-17T04:07:30.892 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-17T04:07:31.044 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-17T04:07:31.044 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-17T04:07:31.927 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-17T04:07:31.927 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-17T04:07:33.250 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-17T04:07:33.251 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-17T04:07:38.326 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-17T04:07:38.434 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:07:38.473 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:07:38.526 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:07:38.568 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:07:38.593 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:07:38.641 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:07:38.979 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:07:39.111 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:07:39.255 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:07:39.287 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:07:39.378 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:07:39.416 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:07:39.455 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:07:39.635 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-17T04:07:39.636 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:07:39.690 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:07:39.717 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:07:39.767 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:07:39.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:07:39.822 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:07:39.851 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:07:39.872 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:07:39.908 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:07:39.917 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:07:39.934 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:07:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:07:39.968 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:07:39.985 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:07:40.149 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:07:40.320 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:07:40.331 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:07:40.442 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:07:40.443 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:07:40.557 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:40.570 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:07:40.603 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:07:40.626 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:40.677 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:07:40.716 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:07:40.755 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:07:40.860 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:40.927 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:07:40.963 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:07:40.980 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:07:40.989 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:07:41.007 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:07:41.031 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:07:41.111 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:07:41.114 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:07:41.142 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:07:41.165 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:07:41.198 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:07:41.209 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:07:41.235 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:07:41.241 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:07:41.255 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:07:41.274 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:07:41.301 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:07:41.369 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:07:41.424 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:07:41.447 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:07:41.463 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:07:41.499 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:07:41.576 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:07:41.609 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:07:41.652 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:07:41.660 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:07:41.681 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:07:41.751 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:07:41.796 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:07:41.808 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:07:41.871 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:07:41.933 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:42.006 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:07:42.042 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:42.065 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:07:42.281 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:07:42.392 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:07:42.422 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:07:42.456 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:07:42.521 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:07:42.566 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:07:42.586 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:07:42.598 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:07:42.641 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:07:42.674 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:07:42.699 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:07:42.701 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:07:42.730 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:07:42.769 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:07:42.774 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:07:42.811 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:07:42.832 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:07:42.862 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:07:42.863 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:07:42.907 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:07:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:07:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:07:43.043 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:07:43.060 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:07:43.089 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:07:43.098 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:07:43.157 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:07:43.187 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:07:43.203 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:07:43.245 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:07:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:07:43.317 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:07:43.359 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:07:43.402 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:07:43.409 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:07:43.450 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:07:43.463 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:07:43.485 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:07:43.528 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:07:43.570 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:07:43.703 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:07:43.962 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:07:43.988 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:07:44.057 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:07:44.076 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:07:44.105 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:07:44.140 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:07:44.160 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:07:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:07:44.206 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:07:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:07:44.247 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:07:44.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:07:44.316 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:07:44.388 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:07:44.412 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:07:44.447 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:07:44.537 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:07:44.540 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:07:44.581 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:07:44.602 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:07:44.609 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:07:44.643 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:07:44.675 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:07:44.682 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:07:44.708 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:07:44.713 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:07:44.744 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:07:44.751 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:07:44.778 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:07:44.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:07:44.820 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:07:44.834 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:07:44.870 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:07:44.876 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:07:44.904 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:07:44.919 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:07:44.990 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:07:45.034 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:07:45.054 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:07:45.065 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:07:45.167 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:07:45.233 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:07:45.288 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:07:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:07:45.465 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:07:45.505 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:07:45.545 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:07:45.578 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:07:45.602 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:07:45.714 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:07:45.837 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:07:45.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:07:45.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:07:45.948 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:07:45.963 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:07:45.997 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:07:46.002 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:07:46.034 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:07:46.037 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:07:46.064 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:07:46.098 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:07:46.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:07:46.135 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:07:46.173 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:07:46.208 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:07:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:07:46.263 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:07:46.294 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:07:46.338 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:07:46.357 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:07:46.373 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:07:46.390 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:07:46.483 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:07:46.532 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:07:46.574 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:07:46.605 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:07:46.682 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:07:47.241 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:07:47.287 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:07:47.321 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:07:47.329 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:07:47.420 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:07:47.451 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:07:47.476 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:07:47.521 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:07:47.608 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:07:47.655 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:07:47.831 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:07:47.855 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:07:47.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:07:48.570 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:07:48.693 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:07:48.698 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:07:48.789 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:07:48.912 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:07:49.064 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:07:49.524 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:07:49.582 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:07:49.697 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:07:49.728 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:07:49.764 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:07:49.946 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:07:50.027 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:07:50.055 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:07:50.088 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:07:50.261 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:07:50.293 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:07:50.380 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:07:50.402 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:07:50.413 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:07:50.460 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:07:50.534 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:07:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:07:50.600 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:07:51.102 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:07:51.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:07:51.201 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:07:51.231 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:07:52.729 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:52.765 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:53.385 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:07:53.481 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:07:53.481 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:07:53.481 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:07:53.481 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:07:53.520 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:07:53.878 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:53.911 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:54.481 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:07:54.522 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:07:54.617 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:07:54.617 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:07:54.617 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:07:54.617 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:07:54.648 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:08:05.418 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:08:05.418 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-09-17T04:08:05.419 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:08:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:08:05.622 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:05.622 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:08:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-17T04:08:06.451 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:06.626 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:08:06.646 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:08:06.646 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:06.646 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:08:06.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:07.234 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:08:07.260 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:08:07.260 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:07.260 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:08:07.260 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:08:07.261 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:08:07.261 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:07.492 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:08:07.515 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:08:07.516 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:07.516 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:08:07.516 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:08:07.516 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:08:07.516 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:07.993 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:08:08.016 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:08:08.016 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:08.016 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:08:08.017 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:08:08.017 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:08:08.017 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:08.114 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:08:08.163 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:08:08.218 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:08:08.229 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:08:08.256 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:08.401 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:08:08.451 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:08:08.496 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:08:08.520 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:08.529 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:08:08.617 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:08:08.755 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:08:08.802 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:08:08.833 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:08:08.861 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:08:08.988 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:08:09.012 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:08:09.012 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:09.013 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:08:09.013 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:08:09.013 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:08:09.013 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:08:09.176 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:08:09.230 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:08:09.324 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:08:09.351 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:08:09.383 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:08:09.416 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:08:09.449 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:08:09.464 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:08:09.474 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:08:09.542 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:08:09.655 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:08:09.797 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:08:09.839 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:08:09.871 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:08:09.899 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:08:10.305 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:08:10.323 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:08:10.354 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:08:10.421 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:08:10.445 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:08:12.623 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:08:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:08:13.616 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:08:13.654 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:08:13.677 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:08:13.680 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:08:13.792 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:08:13.964 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:08:13.999 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:08:14.023 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:14.083 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:08:14.094 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:08:14.193 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:08:14.254 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:08:14.635 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:08:14.660 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:08:14.775 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:08:14.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:08:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:08:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:08:14.986 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:14.986 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:08:14.986 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:08:14.986 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:08:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:15.038 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:08:15.049 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:08:15.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:08:15.208 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:08:15.224 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:08:15.260 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:15.285 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:15.327 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:08:15.350 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:08:15.351 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:15.351 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:08:15.351 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:15.403 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:08:15.427 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:15.745 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:08:15.769 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:16.172 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:08:16.198 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:08:16.222 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:08:16.223 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:16.223 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:08:16.223 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:16.223 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:08:16.223 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:16.266 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:08:16.289 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:08:16.289 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:16.289 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:08:16.289 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:16.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:08:16.365 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:16.684 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:08:16.707 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:08:16.708 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:08:16.708 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:08:16.708 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:08:16.708 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:08:16.708 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:19.783 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:08:19.824 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:08:19.864 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:08:19.896 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:08:19.923 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:08:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:08:20.153 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:08:20.183 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:08:20.213 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:08:20.251 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:08:20.697 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:08:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:08:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:08:20.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:08:20.837 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:08:20.889 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:20.932 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:20.952 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:21.034 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:08:21.076 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:08:21.106 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:08:21.135 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:08:21.174 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:08:21.775 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:21.777 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:08:21.813 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:21.834 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:08:21.869 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:08:21.915 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:08:22.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:08:22.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:08:22.056 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:08:22.099 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:08:22.099 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:08:22.208 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:08:22.208 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:08:22.292 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:08:22.316 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:08:22.322 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:22.322 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:22.510 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:22.510 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:08:22.602 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:08:22.665 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:08:22.678 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:22.759 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:08:22.805 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:08:22.902 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:08:22.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:08:22.962 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:08:22.988 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:08:22.988 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:08:23.081 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:08:23.081 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:08:23.173 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:08:23.198 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:08:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:23.203 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:23.383 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:08:23.383 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:08:23.467 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:08:23.534 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:08:29.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:08:29.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:08:29.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:08:29.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:08:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:08:29.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:08:29.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:08:29.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:08:29.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:08:29.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:08:29.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:08:29.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:08:29.095 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:08:29.096 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:08:29.932 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:08:29.933 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:08:29.934 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:08:29.935 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:08:29.936 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:08:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:08:29.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:08:29.939 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:08:29.940 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:08:29.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:08:29.942 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:08:29.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:08:29.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:08:29.945 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:08:29.946 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:08:29.947 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:08:29.948 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:08:29.948 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:08:29.948 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:08:31.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:31.760 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.761 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.762 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:08:31.763 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:08:31.764 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:08:31.765 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:08:31.766 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:08:31.767 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:08:31.768 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:08:31.769 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:08:31.770 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:08:31.771 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:08:31.772 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:31.773 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-17T04:08:32.192 DEBUG:teuthology.parallel:result is None 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:08:32.404 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.405 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.406 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:08:32.407 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:08:32.408 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:08:32.409 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:08:32.410 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:08:32.411 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:08:32.412 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:08:32.413 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:08:32.414 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:08:32.415 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.416 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:32.417 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-17T04:08:32.831 DEBUG:teuthology.parallel:result is None 2024-09-17T04:08:32.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:08:32.968 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:08:32.994 INFO:teuthology.orchestra.run.smithi104.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:08:32.995 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:08:32.995 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:08:32.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:08:33.137 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:08:33.160 INFO:teuthology.orchestra.run.smithi192.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:08:33.160 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:08:33.160 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:08:33.162 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T04:08:33.162 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:33.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:08:33.195 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:33.195 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:08:33.228 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T04:08:33.228 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:33.228 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:08:33.264 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:08:33.332 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:33.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:08:33.357 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:08:33.422 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T04:08:33.422 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:33.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:08:33.449 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:08:33.515 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:33.515 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:08:33.540 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:08:33.604 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T04:08:33.604 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:33.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:08:33.632 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:08:33.697 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:33.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:08:33.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:08:33.787 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T04:08:33.861 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T04:08:33.861 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-09-17T04:08:33.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2024-09-17T04:08:33.888 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T04:08:33.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:08:33.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:08:33.954 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T04:08:33.954 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:08:33.994 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:08:34.025 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T04:08:34.025 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T04:08:34.025 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T04:08:34.025 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:34.025 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:08:34.073 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:08:34.180 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:08:34.205 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:34.205 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:08:34.220 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:08:34.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:08:34.359 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T04:08:34.360 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T04:08:34.360 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908504', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnGcytejRrCoVnACiz67mXHSx2oWLNSi80riJUDSXSmfHehf897ZD0+gRSKbyTKqFWYFo7xU0t5iy+HSYhPCF4=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMTkULi5TKs72rsGfJ0lyk9X7GQC07HnczSQLhKslWNd7l1t+4Yi3Idald7OIrgj8+0wEvr4TKtHyQqWX6CKSAY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'client.0': ['fs/maxentries']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T04:08:34.360 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:08:34.363 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:08:34.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:08:34.419 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:08:34.475 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:34.475 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:08:34.497 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:08:34.497 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 04:08:23.035520058 +0000 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 04:06:35.852473540 +0000 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 04:06:35.852473540 +0000 2024-09-17T04:08:34.553 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 04:06:35.852473540 +0000 2024-09-17T04:08:34.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:08:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T04:08:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T04:08:34.617 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000265131 s, 1.9 MB/s 2024-09-17T04:08:34.618 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:08:34.675 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-09-17T04:08:34.729 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:08:34.729 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:34.729 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 04:08:23.035520058 +0000 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 04:06:36.174469791 +0000 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 04:06:36.174469791 +0000 2024-09-17T04:08:34.730 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 04:06:36.174469791 +0000 2024-09-17T04:08:34.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:08:34.792 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T04:08:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T04:08:34.793 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000195292 s, 2.6 MB/s 2024-09-17T04:08:34.794 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:08:34.851 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:34.906 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 04:08:23.036520046 +0000 2024-09-17T04:08:34.907 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 04:06:36.500465989 +0000 2024-09-17T04:08:34.907 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 04:06:36.500465989 +0000 2024-09-17T04:08:34.907 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 04:06:36.500465989 +0000 2024-09-17T04:08:34.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:08:34.969 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T04:08:34.969 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T04:08:34.970 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000193199 s, 2.7 MB/s 2024-09-17T04:08:34.971 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:08:35.028 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-09-17T04:08:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:08:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:35.084 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 04:08:23.036520046 +0000 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 04:06:36.848461930 +0000 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 04:06:36.848461930 +0000 2024-09-17T04:08:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 04:06:36.848461930 +0000 2024-09-17T04:08:35.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:08:35.148 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T04:08:35.148 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T04:08:35.148 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000185503 s, 2.8 MB/s 2024-09-17T04:08:35.149 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:08:35.205 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:35.206 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:35.206 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:08:35.222 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:08:35.222 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 04:08:23.898400959 +0000 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 04:06:35.846797647 +0000 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 04:06:35.846797647 +0000 2024-09-17T04:08:35.279 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 04:06:35.846797647 +0000 2024-09-17T04:08:35.280 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:08:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T04:08:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T04:08:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000211658 s, 2.4 MB/s 2024-09-17T04:08:35.344 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:08:35.401 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 04:08:23.899400940 +0000 2024-09-17T04:08:35.457 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 04:06:36.174791230 +0000 2024-09-17T04:08:35.458 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 04:06:36.174791230 +0000 2024-09-17T04:08:35.458 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 04:06:36.174791230 +0000 2024-09-17T04:08:35.458 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:08:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T04:08:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T04:08:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000304878 s, 1.7 MB/s 2024-09-17T04:08:35.523 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:08:35.578 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-17T04:08:35.633 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 04:08:23.899400940 +0000 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 04:06:36.500784852 +0000 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 04:06:36.500784852 +0000 2024-09-17T04:08:35.634 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 04:06:36.500784852 +0000 2024-09-17T04:08:35.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:08:35.696 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T04:08:35.697 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T04:08:35.697 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000214708 s, 2.4 MB/s 2024-09-17T04:08:35.698 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:08:35.753 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 04:08:23.899400940 +0000 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 04:06:36.828778435 +0000 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 04:06:36.828778435 +0000 2024-09-17T04:08:35.809 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 04:06:36.828778435 +0000 2024-09-17T04:08:35.809 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:08:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T04:08:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T04:08:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000253629 s, 2.0 MB/s 2024-09-17T04:08:35.873 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:08:35.929 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:35.929 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:08:35.929 INFO:tasks.ceph:Generating config... 2024-09-17T04:08:35.931 INFO:tasks.ceph:[client] pid file = 2024-09-17T04:08:35.931 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T04:08:35.931 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T04:08:35.931 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T04:08:35.932 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T04:08:35.932 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T04:08:35.933 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T04:08:36.009 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T04:08:36.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T04:08:36.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:08:36.093 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2024-09-17T04:08:36.093 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T04:08:36.094 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:36.094 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:08:36.149 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:36.244 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:36.244 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid 6f80e9a4-ab66-4103-911e-380249777ecb 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:fsid 6f80e9a4-ab66-4103-911e-380249777ecb 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-09-17T04:08:36.246110+0000 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-09-17T04:08:36.246110+0000 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2024-09-17T04:08:36.245 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T04:08:36.246 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:08:36.261 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6f80e9a4-ab66-4103-911e-380249777ecb... 2024-09-17T04:08:36.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:08:36.303 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:08:36.343 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-09-17T04:08:36.343 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:08:36.344 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-09-17T04:08:36.345 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-09-17T04:08:36.346 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on skipped message = False 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = 6f80e9a4-ab66-4103-911e-380249777ecb 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-09-17T04:08:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-09-17T04:08:36.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 20 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 20 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 10 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-09-17T04:08:36.349 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-09-17T04:08:36.350 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:08:36.351 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: mon down mkfs grace = 300 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:08:36.352 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2024-09-17T04:08:36.353 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.354 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2024-09-17T04:08:36.355 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2024-09-17T04:08:36.356 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 6f80e9a4-ab66-4103-911e-380249777ecb 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2024-09-17T04:08:36.357 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.358 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.359 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-17T04:08:36.360 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.361 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: mon down mkfs grace = 300 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2024-09-17T04:08:36.362 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2024-09-17T04:08:36.363 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2024-09-17T04:08:36.363 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-17T04:08:36.363 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-17T04:08:36.363 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-17T04:08:36.363 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-17T04:08:36.364 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T04:08:36.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T04:08:36.469 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T04:08:36.469 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:36.469 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T04:08:36.485 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:36.485 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T04:08:36.539 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:08:36.539 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:36.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:08:36.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:08:36.613 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:08:36.613 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:36.668 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:08:36.668 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:36.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:08:36.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:08:36.703 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:08:36.703 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:36.757 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T04:08:36.758 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T04:08:36.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:08:36.819 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:08:36.822 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:08:36.897 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:08:36.900 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T04:08:36.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:08:36.961 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:08:36.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T04:08:36.988 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:08:37.088 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:08:37.092 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T04:08:37.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:08:37.177 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:08:37.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T04:08:37.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:08:37.305 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:08:37.308 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T04:08:37.333 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T04:08:37.333 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T04:08:37.383 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T04:08:37.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T04:08:37.446 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T04:08:37.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T04:08:37.509 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T04:08:37.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T04:08:37.572 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T04:08:37.585 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T04:08:37.585 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:08:37.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T04:08:37.610 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:37.610 INFO:tasks.ceph:role: osd.0 2024-09-17T04:08:37.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:08:37.610 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:37.682 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:37.683 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:38.192 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T04:08:38.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T04:08:38.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T04:08:38.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T04:08:38.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T04:08:38.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:38.448 INFO:tasks.ceph:role: osd.1 2024-09-17T04:08:38.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:08:38.448 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:08:38.521 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:38.521 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:38.521 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:38.522 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:38.967 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T04:08:38.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T04:08:38.969 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T04:08:39.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T04:08:39.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T04:08:39.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:39.150 INFO:tasks.ceph:role: osd.2 2024-09-17T04:08:39.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:08:39.150 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:08:39.222 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:39.223 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:39.729 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T04:08:39.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T04:08:39.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T04:08:39.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T04:08:39.903 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T04:08:39.968 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:39.968 INFO:tasks.ceph:role: osd.3 2024-09-17T04:08:39.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:08:39.968 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:40.041 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:40.042 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:40.530 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T04:08:40.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T04:08:40.533 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T04:08:40.687 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T04:08:40.717 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:40.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:40.837+0000 7fbdb13d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T04:08:40.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:40.837+0000 7fbdb13d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T04:08:40.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:40.837+0000 7fbdb13d9640 -1 bdev(0x55aea5e45900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T04:08:40.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:40.837+0000 7fbdb13d9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T04:08:44.255 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:08:44.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:44.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:44.388+0000 7f626dcfe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T04:08:44.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:44.388+0000 7f626dcfe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T04:08:44.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:44.388+0000 7f626dcfe640 -1 bdev(0x5570e8011900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T04:08:44.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:44.388+0000 7f626dcfe640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T04:08:48.054 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:08:48.084 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:48.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:48.188+0000 7fcb5fe0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T04:08:48.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:48.188+0000 7fcb5fe0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T04:08:48.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:48.188+0000 7fcb5fe0b640 -1 bdev(0x55f203935900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T04:08:48.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:48.189+0000 7fcb5fe0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T04:08:51.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:08:51.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:51.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:51.481+0000 7f2b23745640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T04:08:51.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:51.481+0000 7f2b23745640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T04:08:51.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:51.481+0000 7f2b23745640 -1 bdev(0x55898de7b900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T04:08:51.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:08:51.481+0000 7f2b23745640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T04:08:54.658 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:08:54.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T04:08:54.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:54.717 INFO:tasks.ceph:role: osd.4 2024-09-17T04:08:54.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:08:54.718 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:08:54.793 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:54.793 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:54.793 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:54.793 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:54.793 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:54.794 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:54.794 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:54.794 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:54.794 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:54.794 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:55.307 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T04:08:55.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T04:08:55.310 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T04:08:55.431 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T04:08:55.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T04:08:55.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:55.527 INFO:tasks.ceph:role: osd.5 2024-09-17T04:08:55.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:08:55.527 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:55.599 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:55.600 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:55.600 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:56.058 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T04:08:56.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T04:08:56.060 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T04:08:56.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T04:08:56.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T04:08:56.245 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:56.245 INFO:tasks.ceph:role: osd.6 2024-09-17T04:08:56.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:08:56.246 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:56.317 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:56.318 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:56.318 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:56.318 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:56.805 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T04:08:56.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T04:08:56.807 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T04:08:56.956 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T04:08:56.989 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T04:08:57.054 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:08:57.054 INFO:tasks.ceph:role: osd.7 2024-09-17T04:08:57.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:08:57.054 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:08:57.128 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:08:57.128 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:08:57.128 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:08:57.128 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:08:57.129 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:08:57.628 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T04:08:57.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T04:08:57.631 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T04:08:57.754 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T04:08:57.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:08:57.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:08:57.915+0000 7f452c013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T04:08:57.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:08:57.915+0000 7f452c013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T04:08:57.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:08:57.915+0000 7f452c013640 -1 bdev(0x555b8a443900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T04:08:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:08:57.916+0000 7f452c013640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T04:09:01.074 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:09:01.100 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:09:01.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:01.197+0000 7f9d84862640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T04:09:01.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:01.198+0000 7f9d84862640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T04:09:01.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:01.198+0000 7f9d84862640 -1 bdev(0x5621c3bc1900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T04:09:01.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:01.198+0000 7f9d84862640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T04:09:04.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:09:04.364 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:09:04.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:09:04.437 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:09:04.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:04.537+0000 7f5e25e0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T04:09:04.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:04.537+0000 7f5e25e0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T04:09:04.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:04.537+0000 7f5e25e0d640 -1 bdev(0x55dc35c7b900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T04:09:04.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:04.537+0000 7f5e25e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T04:09:08.458 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T04:09:08.528 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:09:08.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:08.631+0000 7f212149c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T04:09:08.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:08.631+0000 7f212149c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T04:09:08.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:08.631+0000 7f212149c640 -1 bdev(0x55810b5c1900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T04:09:08.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:08.631+0000 7f212149c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T04:09:11.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T04:09:11.829 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T04:09:11.829 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:11.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T04:09:11.860 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:11.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T04:09:11.927 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:11.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T04:09:11.994 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:11.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T04:09:12.060 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:12.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T04:09:12.126 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:12.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T04:09:12.191 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:12.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T04:09:12.257 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.257 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T04:09:12.287 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.287 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T04:09:12.354 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.355 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T04:09:12.421 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T04:09:12.488 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T04:09:12.555 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T04:09:12.620 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T04:09:12.686 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:12.686 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T04:09:12.702 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:12.702 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T04:09:12.759 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.759 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T04:09:12.774 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:12.774 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T04:09:12.830 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T04:09:12.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:09:12.832 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDEAOlmXNfoMBAACP7Ue9oKopxfMcAvTT0UnA== 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDEAOlm1wJlORAAItBVyz4g69mrEOA56N83MQ== 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmSYViBRAAuZtrOfkC86ZdVMosip1OXQ== 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDIAOlmr+X0MRAAuNSi7ayeB2pJfdbv1Kkmzw== 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-09-17T04:09:12.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDMAOlmVzYxFxAArb4U8YaBxyW0P0sXIkMWig== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDQAOlm3fdMCxAATUBPPbqsMSbZGZWN5yGAww== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDTAOlmm6+7HBAAj1kSJD8icTMpT9zUGJOpZA== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDEAOlmJtWaNRAAwnB+nevdRVddhSxM/pxtmw== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmX76qChAAv16rn9YBciA1rlqbpJ3ALw== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmX+xHEhAA4B37T3Z8D1ObKiNFJPcm6Q== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDZAOlmZyalNhAA4n64K7MuIMP9+zqblmmobA== 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-09-17T04:09:12.874 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDdAOlmN5HbCxAA9V6OW+JK9nxEI7rrzGO2Wg== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDgAOlmM14cIBAAP2oWlqIvDfQLN9xLebO+mg== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDkAOlmhJ63JRAA68cztjJz7rSumAcqRnTUzA== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmk6PvFhAAh7G1NWmVbjMfXMBvkGqnyg== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmjkytGhAA/CP7uqq7bXHec9+EzW5OfA== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmNw15HhAAq6lCam0ZOTi5sGvT+8HU0g== 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2024-09-17T04:09:12.875 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQDFAOlmEN0zIhAALm7rbTg92i9jXmC1wwjdow== 2024-09-17T04:09:12.892 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDEAOlmXNfoMBAACP7Ue9oKopxfMcAvTT0UnA== 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDEAOlm1wJlORAAItBVyz4g69mrEOA56N83MQ== 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmSYViBRAAuZtrOfkC86ZdVMosip1OXQ== 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDIAOlmr+X0MRAAuNSi7ayeB2pJfdbv1Kkmzw== 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDMAOlmVzYxFxAArb4U8YaBxyW0P0sXIkMWig== 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2024-09-17T04:09:12.893 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDQAOlm3fdMCxAATUBPPbqsMSbZGZWN5yGAww== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDTAOlmm6+7HBAAj1kSJD8icTMpT9zUGJOpZA== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDEAOlmJtWaNRAAwnB+nevdRVddhSxM/pxtmw== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmX76qChAAv16rn9YBciA1rlqbpJ3ALw== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmX+xHEhAA4B37T3Z8D1ObKiNFJPcm6Q== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDZAOlmZyalNhAA4n64K7MuIMP9+zqblmmobA== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdAOlmN5HbCxAA9V6OW+JK9nxEI7rrzGO2Wg== 2024-09-17T04:09:12.894 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDgAOlmM14cIBAAP2oWlqIvDfQLN9xLebO+mg== 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDkAOlmhJ63JRAA68cztjJz7rSumAcqRnTUzA== 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmk6PvFhAAh7G1NWmVbjMfXMBvkGqnyg== 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmjkytGhAA/CP7uqq7bXHec9+EzW5OfA== 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmNw15HhAAq6lCam0ZOTi5sGvT+8HU0g== 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2024-09-17T04:09:12.895 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDFAOlmEN0zIhAALm7rbTg92i9jXmC1wwjdow== 2024-09-17T04:09:12.896 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:09:12.919 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:09:12.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.000 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.068 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.133 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.261 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.263 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:09:13.391 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:09:13.453 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.455 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:09:13.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.652 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.714 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.778 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.780 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:09:13.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:13.844 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:13.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:13.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:13.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:13.978 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:14.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:14.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:09:14.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T04:09:14.109 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T04:09:14.133 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:09:14.239 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T04:09:14.264 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T04:09:14.289 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:09:14.396 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T04:09:14.421 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T04:09:14.486 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:09:14.592 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T04:09:14.617 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:09:14.620 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:09:14.672 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T04:09:14.673 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T04:09:14.673 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T04:09:14.675 INFO:tasks.ceph.mon.a:Started 2024-09-17T04:09:14.676 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T04:09:14.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T04:09:14.715 INFO:tasks.ceph.mon.b:Started 2024-09-17T04:09:14.715 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T04:09:14.715 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T04:09:14.720 INFO:tasks.ceph.mon.c:Started 2024-09-17T04:09:14.721 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T04:09:14.721 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T04:09:14.721 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T04:09:14.723 INFO:tasks.ceph.mgr.y:Started 2024-09-17T04:09:14.723 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T04:09:14.724 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T04:09:14.728 INFO:tasks.ceph.mgr.x:Started 2024-09-17T04:09:14.728 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T04:09:14.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T04:09:14.731 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T04:09:14.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T04:09:14.775 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T04:09:14.775 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T04:09:14.819 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T04:09:14.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T04:09:14.862 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T04:09:14.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T04:09:14.905 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T04:09:14.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T04:09:14.948 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T04:09:14.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T04:09:14.992 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T04:09:14.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T04:09:15.036 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T04:09:15.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T04:09:15.079 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T04:09:15.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T04:09:15.122 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T04:09:15.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T04:09:15.167 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T04:09:15.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T04:09:15.201 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T04:09:15.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T04:09:15.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 -- 172.21.15.104:0/1062165314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ba80ca0f0 msgr2=0x7f9ba80b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 --2- 172.21.15.104:0/1062165314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ba80ca0f0 0x7f9ba80b04c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8074500 tx=0x7f9ba0006790 comp rx=0 tx=0).stop 2024-09-17T04:09:15.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 -- 172.21.15.104:0/1062165314 shutdown_connections 2024-09-17T04:09:15.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 --2- 172.21.15.104:0/1062165314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba81e6020 0x7f9ba80c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 --2- 172.21.15.104:0/1062165314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ba80ca0f0 0x7f9ba80b04c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 --2- 172.21.15.104:0/1062165314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba80d02b0 0x7f9ba81f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.211+0000 7f9bad3ad640 1 -- 172.21.15.104:0/1062165314 >> 172.21.15.104:0/1062165314 conn(0x7f9ba80735d0 msgr2=0x7f9ba806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.212+0000 7f9bad3ad640 1 -- 172.21.15.104:0/1062165314 shutdown_connections 2024-09-17T04:09:15.213 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T04:09:15.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T04:09:15.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.214+0000 7f9bad3ad640 1 -- 172.21.15.104:0/1062165314 wait complete. 2024-09-17T04:09:15.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.217+0000 7f74e8ff9640 1 -- 172.21.15.104:0/3620838835 <== mon.2 v2:172.21.15.192:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f74e0010430 con 0x7f74e4035ec0 2024-09-17T04:09:15.218 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T04:09:15.218 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T04:09:15.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.219+0000 7ff3497fa640 1 -- 172.21.15.104:0/802224465 <== mon.0 v2:172.21.15.104:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff33c011ae0 con 0x7ff34c0a9450 2024-09-17T04:09:15.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.221+0000 7f6bbe7fc640 1 -- 172.21.15.104:0/4135363859 <== mon.2 v2:172.21.15.192:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f6bc40233f0 con 0x7f6bb4004800 2024-09-17T04:09:15.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.221+0000 7f6bbe7fc640 1 -- 172.21.15.104:0/4135363859 <== mon.2 v2:172.21.15.192:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v5)=0 v5) ==== 114+0+0 (secure 0 0 0) 0x7f6bc4023720 con 0x7f6bb4004800 2024-09-17T04:09:15.226 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T04:09:15.227 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T04:09:15.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 -- 172.21.15.104:0/4135363859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb4004800 msgr2=0x7f6bc80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 --2- 172.21.15.104:0/4135363859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb4004800 0x7f6bc80cbea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400d920 tx=0x7f6bc400dd20 comp rx=0 tx=0).stop 2024-09-17T04:09:15.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 -- 172.21.15.104:0/4135363859 shutdown_connections 2024-09-17T04:09:15.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 --2- 172.21.15.104:0/4135363859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8154d00 0x7f6bc809e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 --2- 172.21.15.104:0/4135363859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc81548f0 0x7f6bc809b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 --2- 172.21.15.104:0/4135363859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bb4004800 0x7f6bc80cbea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.225+0000 7f6bcff6e640 1 -- 172.21.15.104:0/4135363859 >> 172.21.15.104:0/4135363859 conn(0x7f6bc80cdca0 msgr2=0x7f6bc80712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.226+0000 7f6bcff6e640 1 -- 172.21.15.104:0/4135363859 shutdown_connections 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.226+0000 7f6bcff6e640 1 -- 172.21.15.104:0/4135363859 wait complete. 2024-09-17T04:09:15.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.223+0000 7fa9aaffd640 1 -- 172.21.15.104:0/1374096726 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fa9ac005630 con 0x7fa9b4074590 2024-09-17T04:09:15.241 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T04:09:15.241 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T04:09:15.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.245+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f74c4005310 con 0x7f74e4035ec0 2024-09-17T04:09:15.247 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T04:09:15.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T04:09:15.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.254+0000 7f74e8ff9640 1 -- 172.21.15.104:0/3620838835 <== mon.2 v2:172.21.15.192:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e00047e0 con 0x7f74e4035ec0 2024-09-17T04:09:15.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.254+0000 7f74e8ff9640 1 -- 172.21.15.104:0/3620838835 <== mon.2 v2:172.21.15.192:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f74e0004b60 con 0x7f74e4035ec0 2024-09-17T04:09:15.258 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T04:09:15.258 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T04:09:15.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.256+0000 7fa9aaffd640 1 -- 172.21.15.104:0/1374096726 <== mon.0 v2:172.21.15.104:3300/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9ac032980 con 0x7fa9b4074590 2024-09-17T04:09:15.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7ff3497fa640 1 -- 172.21.15.104:0/802224465 <== mon.0 v2:172.21.15.104:3300/0 10 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff33c0103c0 con 0x7ff34c0a9450 2024-09-17T04:09:15.269 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T04:09:15.270 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T04:09:15.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74e4035ec0 msgr2=0x7f74e4177ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 --2- 172.21.15.104:0/3620838835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74e4035ec0 0x7f74e4177ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e7f0 tx=0x7f74e000ecb0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 shutdown_connections 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 --2- 172.21.15.104:0/3620838835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74e40e0030 0x7f74e4051180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 --2- 172.21.15.104:0/3620838835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74e4052fc0 0x7f74e404d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 --2- 172.21.15.104:0/3620838835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74e4035ec0 0x7f74e4177ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 >> 172.21.15.104:0/3620838835 conn(0x7f74e401e260 msgr2=0x7f74e400a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.267+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 shutdown_connections 2024-09-17T04:09:15.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.268+0000 7f74f1071640 1 -- 172.21.15.104:0/3620838835 wait complete. 2024-09-17T04:09:15.277 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T04:09:15.278 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T04:09:15.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.281+0000 7fd344238640 1 -- 172.21.15.104:0/3209729544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd328003a50 msgr2=0x7fd328003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.281+0000 7fd344238640 1 --2- 172.21.15.104:0/3209729544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd328003a50 0x7fd328003ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c640 tx=0x7fd328005830 comp rx=0 tx=0).stop 2024-09-17T04:09:15.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.282+0000 7fd344238640 1 -- 172.21.15.104:0/3209729544 shutdown_connections 2024-09-17T04:09:15.282 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T04:09:15.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T04:09:15.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.282+0000 7fd344238640 1 --2- 172.21.15.104:0/3209729544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd328003a50 0x7fd328003ea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.282+0000 7fd344238640 1 -- 172.21.15.104:0/3209729544 >> 172.21.15.104:0/3209729544 conn(0x7fd33c0b1b90 msgr2=0x7fd33c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.283+0000 7fd344238640 1 -- 172.21.15.104:0/3209729544 shutdown_connections 2024-09-17T04:09:15.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.284+0000 7fd344238640 1 -- 172.21.15.104:0/3209729544 wait complete. 2024-09-17T04:09:15.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.286+0000 7fd344238640 1 Processor -- start 2024-09-17T04:09:15.290 DEBUG:tasks.ceph:set 22 configs 2024-09-17T04:09:15.290 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.291 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.291 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.291 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.291 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.287+0000 7fd344238640 1 -- start start 2024-09-17T04:09:15.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.289+0000 7fd344238640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 0x7fd33c09cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd344238640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd3417d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd3417d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46428/0 (socket says 172.21.15.104:46428) 2024-09-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd3417d3640 1 -- 172.21.15.104:0/1973445665 learned_addr learned my addr 172.21.15.104:0/1973445665 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd344238640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd33c1f9740 0x7fd33c09a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c06e200 con 0x7fd33c0c83a0 2024-09-17T04:09:15.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.293+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c071090 con 0x7fd33c0c9090 2024-09-17T04:09:15.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.294+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c06e380 con 0x7fd33c1f9740 2024-09-17T04:09:15.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.294+0000 7fd3427d5640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd33c1f9740 0x7fd33c09a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.295+0000 7fd341fd4640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 0x7fd33c09cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.296+0000 7fd3417d3640 1 -- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd33c1f9740 msgr2=0x7fd33c09a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.296+0000 7fd3417d3640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd33c1f9740 0x7fd33c09a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.296+0000 7fd3417d3640 1 -- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 msgr2=0x7fd33c09cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.296+0000 7fd3417d3640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 0x7fd33c09cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.296+0000 7fd3417d3640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c1f9ed0 con 0x7fd33c0c83a0 2024-09-17T04:09:15.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.297+0000 7fd341fd4640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 0x7fd33c09cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.298+0000 7fd3417d3640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd33c072d40 tx=0x7fd32c009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.301+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c004230 con 0x7fd33c0c83a0 2024-09-17T04:09:15.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.301+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c09e520 con 0x7fd33c0c83a0 2024-09-17T04:09:15.305 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.305+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c0c8e20 con 0x7fd33c0c83a0 2024-09-17T04:09:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.306+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd32c0035f0 con 0x7fd33c0c83a0 2024-09-17T04:09:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.306+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0044c0 con 0x7fd33c0c83a0 2024-09-17T04:09:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.307+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd32c00e630 con 0x7fd33c0c83a0 2024-09-17T04:09:15.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.307+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd32c014d90 con 0x7fd33c0c83a0 2024-09-17T04:09:15.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.311+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd324005290 con 0x7fd33c0c83a0 2024-09-17T04:09:15.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.316+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd32c011070 con 0x7fd33c0c83a0 2024-09-17T04:09:15.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.425+0000 7f63e7630640 1 -- 172.21.15.104:0/2046239374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e0073070 msgr2=0x7f63e008b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.425+0000 7f63e7630640 1 --2- 172.21.15.104:0/2046239374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e0073070 0x7f63e008b9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009880 tx=0x7f63dc02a480 comp rx=0 tx=0).stop 2024-09-17T04:09:15.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 -- 172.21.15.104:0/2046239374 shutdown_connections 2024-09-17T04:09:15.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 --2- 172.21.15.104:0/2046239374 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e016f320 0x7f63e00b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 --2- 172.21.15.104:0/2046239374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e0073070 0x7f63e008b9e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 -- 172.21.15.104:0/2046239374 >> 172.21.15.104:0/2046239374 conn(0x7f63e006cde0 msgr2=0x7f63e006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 -- 172.21.15.104:0/2046239374 shutdown_connections 2024-09-17T04:09:15.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.426+0000 7f63e7630640 1 -- 172.21.15.104:0/2046239374 wait complete. 2024-09-17T04:09:15.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.429+0000 7f63e7630640 1 Processor -- start 2024-09-17T04:09:15.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.430+0000 7f63e7630640 1 -- start start 2024-09-17T04:09:15.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.432+0000 7f63e7630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e53cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e53cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46448/0 (socket says 172.21.15.104:46448) 2024-09-17T04:09:15.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e53cc640 1 -- 172.21.15.104:0/1982943183 learned_addr learned my addr 172.21.15.104:0/1982943183 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e7630640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e020e390 0x7f63e0159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e7630640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e0209cc0 0x7f63e01569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e7630640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63e00b39d0 con 0x7f63e006edf0 2024-09-17T04:09:15.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e7630640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63e00b3850 con 0x7f63e0209cc0 2024-09-17T04:09:15.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.433+0000 7f63e7630640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63e00b3b50 con 0x7f63e020e390 2024-09-17T04:09:15.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.434+0000 7f63e4bcb640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e020e390 0x7f63e0159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e5bcd640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e0209cc0 0x7f63e01569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e53cc640 1 -- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e020e390 msgr2=0x7f63e0159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e53cc640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e020e390 0x7f63e0159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e53cc640 1 -- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e0209cc0 msgr2=0x7f63e01569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e53cc640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e0209cc0 0x7f63e01569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.439+0000 7f63e53cc640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e0164fa0 con 0x7f63e006edf0 2024-09-17T04:09:15.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.440+0000 7f63e53cc640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097d0 tx=0x7f63dc030c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.440+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc040070 con 0x7f63e006edf0 2024-09-17T04:09:15.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.441+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63dc004020 con 0x7f63e006edf0 2024-09-17T04:09:15.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.441+0000 7f63e7630640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e0165280 con 0x7f63e006edf0 2024-09-17T04:09:15.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.441+0000 7f63e7630640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e01598a0 con 0x7f63e006edf0 2024-09-17T04:09:15.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.443+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc037040 con 0x7f63e006edf0 2024-09-17T04:09:15.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.444+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63dc003980 con 0x7f63e006edf0 2024-09-17T04:09:15.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.445+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63dc03c8d0 con 0x7f63e006edf0 2024-09-17T04:09:15.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.445+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c0005290 con 0x7f63e006edf0 2024-09-17T04:09:15.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.462+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f63dc04a020 con 0x7f63e006edf0 2024-09-17T04:09:15.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.477+0000 7fa9b8c5c640 1 -- 172.21.15.104:0/1374096726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fa998001690 con 0x7fa9b4074590 2024-09-17T04:09:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.491+0000 7fa9aaffd640 1 -- 172.21.15.104:0/1374096726 <== mon.0 v2:172.21.15.104:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v7)=0 v7) ==== 117+0+0 (secure 0 0 0) 0x7fa9ac032b30 con 0x7fa9b4074590 2024-09-17T04:09:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.492+0000 7fa9a8ff9640 1 -- 172.21.15.104:0/1374096726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b4074590 msgr2=0x7fa9b41579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.492+0000 7fa9a8ff9640 1 --2- 172.21.15.104:0/1374096726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b4074590 0x7fa9b41579d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0098f0 tx=0x7fa9ac0046c0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.493+0000 7fa9a8ff9640 1 -- 172.21.15.104:0/1374096726 shutdown_connections 2024-09-17T04:09:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.493+0000 7fa9a8ff9640 1 --2- 172.21.15.104:0/1374096726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b4074590 0x7fa9b41579d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.493+0000 7fa9a8ff9640 1 --2- 172.21.15.104:0/1374096726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b40711b0 0x7fa9b415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.493+0000 7fa9a8ff9640 1 --2- 172.21.15.104:0/1374096726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b406ddf0 0x7fa9b414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.493+0000 7fa9a8ff9640 1 -- 172.21.15.104:0/1374096726 >> 172.21.15.104:0/1374096726 conn(0x7fa9b40735d0 msgr2=0x7fa9b40cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.504+0000 7fa9a8ff9640 1 -- 172.21.15.104:0/1374096726 shutdown_connections 2024-09-17T04:09:15.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.504+0000 7fa9a8ff9640 1 -- 172.21.15.104:0/1374096726 wait complete. 2024-09-17T04:09:15.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.527+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7ff3240052f0 con 0x7ff34c0a9450 2024-09-17T04:09:15.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.534+0000 7ff3497fa640 1 -- 172.21.15.104:0/802224465 <== mon.0 v2:172.21.15.104:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v8)=0 v8) ==== 108+0+0 (secure 0 0 0) 0x7ff33c01ab70 con 0x7ff34c0a9450 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0a9450 msgr2=0x7ff34c0a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 --2- 172.21.15.104:0/802224465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0a9450 0x7ff34c0a9860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00e960 tx=0x7ff33c00ee20 comp rx=0 tx=0).stop 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 shutdown_connections 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 --2- 172.21.15.104:0/802224465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff34c204fd0 0x7ff34c2053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 --2- 172.21.15.104:0/802224465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff34c0a9450 0x7ff34c0a9860 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 --2- 172.21.15.104:0/802224465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff334003a80 0x7ff34c1ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 >> 172.21.15.104:0/802224465 conn(0x7ff34c0735d0 msgr2=0x7ff34c159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.536+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 shutdown_connections 2024-09-17T04:09:15.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.540+0000 7ff3531e6640 1 -- 172.21.15.104:0/802224465 wait complete. 2024-09-17T04:09:15.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.542+0000 7f6676cce640 1 -- 172.21.15.104:0/929736808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6658003b90 msgr2=0x7f6658003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.542+0000 7f6676cce640 1 --2- 172.21.15.104:0/929736808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6658003b90 0x7f6658003fc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6668001f90 tx=0x7f6658005830 comp rx=0 tx=0).stop 2024-09-17T04:09:15.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.548+0000 7f6676cce640 1 -- 172.21.15.104:0/929736808 shutdown_connections 2024-09-17T04:09:15.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.548+0000 7f6676cce640 1 --2- 172.21.15.104:0/929736808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6658003b90 0x7f6658003fc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.548+0000 7f6676cce640 1 -- 172.21.15.104:0/929736808 >> 172.21.15.104:0/929736808 conn(0x7f66700735d0 msgr2=0x7f66700739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.549+0000 7f6676cce640 1 -- 172.21.15.104:0/929736808 shutdown_connections 2024-09-17T04:09:15.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.555+0000 7f6676cce640 1 -- 172.21.15.104:0/929736808 wait complete. 2024-09-17T04:09:15.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.557+0000 7f6676cce640 1 Processor -- start 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.558+0000 7f6676cce640 1 -- start start 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667008a9e0 0x7f66700b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66700b4ee0 0x7f667015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f667006e200 con 0x7f6658003b90 2024-09-17T04:09:15.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66700cb3c0 con 0x7f66700b4ee0 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.560+0000 7f6676cce640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f667006e380 con 0x7f667008a9e0 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f667526b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66700b4ee0 0x7f667015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46450/0 (socket says 172.21.15.104:46450) 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 -- 172.21.15.104:0/3933738679 learned_addr learned my addr 172.21.15.104:0/3933738679 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f666ffff640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667008a9e0 0x7f66700b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 -- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667008a9e0 msgr2=0x7f66700b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667008a9e0 0x7f66700b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 -- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66700b4ee0 msgr2=0x7f667015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66700b4ee0 0x7f667015c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.561+0000 7f6674a6a640 1 -- 172.21.15.104:0/3933738679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66700b5ab0 con 0x7f6658003b90 2024-09-17T04:09:15.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.562+0000 7f6674a6a640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f666804cf10 tx=0x7f6668006830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.562+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668058040 con 0x7f6658003b90 2024-09-17T04:09:15.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.562+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6668064070 con 0x7f6658003b90 2024-09-17T04:09:15.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.562+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666804f070 con 0x7f6658003b90 2024-09-17T04:09:15.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.562+0000 7f6676cce640 1 -- 172.21.15.104:0/3933738679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66700b5d90 con 0x7f6658003b90 2024-09-17T04:09:15.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.563+0000 7f6676cce640 1 -- 172.21.15.104:0/3933738679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66700c7e20 con 0x7f6658003b90 2024-09-17T04:09:15.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.570+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66700cb540 con 0x7f6658003b90 2024-09-17T04:09:15.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.578+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f666805f660 con 0x7f6658003b90 2024-09-17T04:09:15.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.578+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f66680687d0 con 0x7f6658003b90 2024-09-17T04:09:15.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.578+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6668068a20 con 0x7f6658003b90 2024-09-17T04:09:15.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.582+0000 7f9a927a1640 1 -- 172.21.15.104:0/2706886632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84056da0 msgr2=0x7f9a84057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.582+0000 7f9a927a1640 1 --2- 172.21.15.104:0/2706886632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84056da0 0x7f9a84057c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a84011f00 tx=0x7f9a8c0a63e0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.584+0000 7fb03b59e640 1 -- 172.21.15.104:0/1108593808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb024003ad0 msgr2=0x7fb024003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.584+0000 7fb03b59e640 1 --2- 172.21.15.104:0/1108593808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb024003ad0 0x7fb024003f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0340045f0 tx=0x7fb024005830 comp rx=0 tx=0).stop 2024-09-17T04:09:15.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.585+0000 7fb03ad9d640 1 -- 172.21.15.104:0/1108593808 reap_dead start 2024-09-17T04:09:15.586 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.586 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.586+0000 7fb03b59e640 1 -- 172.21.15.104:0/1108593808 shutdown_connections 2024-09-17T04:09:15.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.586+0000 7fb03b59e640 1 -- 172.21.15.104:0/1108593808 >> 172.21.15.104:0/1108593808 conn(0x7fb03c0cfec0 msgr2=0x7fb03c0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.586+0000 7fb03b59e640 1 -- 172.21.15.104:0/1108593808 shutdown_connections 2024-09-17T04:09:15.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.591+0000 7f9a927a1640 1 -- 172.21.15.104:0/2706886632 shutdown_connections 2024-09-17T04:09:15.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.591+0000 7f9a927a1640 1 --2- 172.21.15.104:0/2706886632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a84053c50 0x7f9a84054060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.591+0000 7f9a927a1640 1 --2- 172.21.15.104:0/2706886632 >> v2:172.21.15.192:3300/0 conn(0x7f9a840e2f40 0x7f9a8403c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.591+0000 7f9a927a1640 1 --2- 172.21.15.104:0/2706886632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84056da0 0x7f9a84057c80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.591+0000 7f9a927a1640 1 -- 172.21.15.104:0/2706886632 >> 172.21.15.104:0/2706886632 conn(0x7f9a8403a5f0 msgr2=0x7f9a8403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.586+0000 7fb03b59e640 1 -- 172.21.15.104:0/1108593808 wait complete. 2024-09-17T04:09:15.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.589+0000 7fb03b59e640 1 Processor -- start 2024-09-17T04:09:15.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.596+0000 7fb03b59e640 1 -- start start 2024-09-17T04:09:15.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.608+0000 7fb03b59e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.605+0000 7f9a927a1640 1 -- 172.21.15.104:0/2706886632 shutdown_connections 2024-09-17T04:09:15.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.606+0000 7f9a927a1640 1 -- 172.21.15.104:0/2706886632 wait complete. 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.608+0000 7fb03b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb03c216070 0x7fb03c216480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03b59e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c2169c0 0x7fb03c0a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:54904/0 (socket says 172.21.15.104:54904) 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03a59c640 1 -- 172.21.15.104:0/2074572628 learned_addr learned my addr 172.21.15.104:0/2074572628 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03b59e640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c16b4c0 con 0x7fb03c216070 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03b59e640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c16b340 con 0x7fb03c0b05c0 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03ad9d640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c2169c0 0x7fb03c0a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.609+0000 7fb03b59e640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb03c16b640 con 0x7fb03c2169c0 2024-09-17T04:09:15.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.608+0000 7f9a927a1640 1 Processor -- start 2024-09-17T04:09:15.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.613+0000 7f9a927a1640 1 -- start start 2024-09-17T04:09:15.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb039d9b640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb03c216070 0x7fb03c216480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb03a59c640 1 -- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c2169c0 msgr2=0x7fb03c0a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb03a59c640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c2169c0 0x7fb03c0a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb03a59c640 1 -- 172.21.15.104:0/2074572628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb03c216070 msgr2=0x7fb03c216480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb03a59c640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb03c216070 0x7fb03c216480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.614+0000 7fb03a59c640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c213580 con 0x7fb03c0b05c0 2024-09-17T04:09:15.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.615+0000 7fb03a59c640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb0340039f0 tx=0x7fb034001f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.615+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0340042c0 con 0x7fb03c0b05c0 2024-09-17T04:09:15.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.616+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb034001940 con 0x7fb03c0b05c0 2024-09-17T04:09:15.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.616+0000 7fb03b59e640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c213860 con 0x7fb03c0b05c0 2024-09-17T04:09:15.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.616+0000 7fb03b59e640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c213e20 con 0x7fb03c0b05c0 2024-09-17T04:09:15.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.616+0000 7f9a927a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.617+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034007750 con 0x7fb03c0b05c0 2024-09-17T04:09:15.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb034041420 con 0x7fb03c0b05c0 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46486/0 (socket says 172.21.15.104:46486) 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a8bfff640 1 -- 172.21.15.104:0/968455807 learned_addr learned my addr 172.21.15.104:0/968455807 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a927a1640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84056da0 0x7f9a8418a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a927a1640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 0x7f9a8418ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.619+0000 7f9a927a1640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84006f20 con 0x7f9a84053c50 2024-09-17T04:09:15.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a927a1640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84006da0 con 0x7f9a84056da0 2024-09-17T04:09:15.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a90d3e640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 0x7f9a8418ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a927a1640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9a840070a0 con 0x7f9a840e2f40 2024-09-17T04:09:15.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb034036800 con 0x7fb03c0b05c0 2024-09-17T04:09:15.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a8bfff640 1 -- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 msgr2=0x7f9a8418ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a8bfff640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 0x7f9a8418ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a8bfff640 1 -- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84056da0 msgr2=0x7f9a8418a840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a8bfff640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84056da0 0x7f9a8418a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.620+0000 7f9a8bfff640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a84009c60 con 0x7f9a84053c50 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.621+0000 7f9a8bfff640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c06bfc0 tx=0x7f9a8c0ac430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.621+0000 7f9a90d3e640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 0x7f9a8418ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.622+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0bb070 con 0x7f9a84053c50 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.622+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a8c0acbe0 con 0x7f9a84053c50 2024-09-17T04:09:15.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.622+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0c0460 con 0x7f9a84053c50 2024-09-17T04:09:15.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.623+0000 7f9a927a1640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a84009f40 con 0x7f9a84053c50 2024-09-17T04:09:15.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.623+0000 7f9a927a1640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8416bb70 con 0x7f9a84053c50 2024-09-17T04:09:15.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.625+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a8c0c0600 con 0x7f9a84053c50 2024-09-17T04:09:15.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.628+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c005290 con 0x7f9a84053c50 2024-09-17T04:09:15.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.631+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a8c0b7ba0 con 0x7f9a84053c50 2024-09-17T04:09:15.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.632+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb020005290 con 0x7fb03c0b05c0 2024-09-17T04:09:15.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.632+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9a8c0ce020 con 0x7f9a84053c50 2024-09-17T04:09:15.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.638+0000 7fa70b415640 1 -- 172.21.15.104:0/411407169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70406da40 msgr2=0x7fa7041621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb034047060 con 0x7fb03c0b05c0 2024-09-17T04:09:15.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.638+0000 7fa70b415640 1 --2- 172.21.15.104:0/411407169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70406da40 0x7fa7041621f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa700009860 tx=0x7fa70002a510 comp rx=0 tx=0).stop 2024-09-17T04:09:15.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7fa70b415640 1 -- 172.21.15.104:0/411407169 shutdown_connections 2024-09-17T04:09:15.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7fa70b415640 1 --2- 172.21.15.104:0/411407169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70406da40 0x7fa7041621f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7fa70b415640 1 -- 172.21.15.104:0/411407169 >> 172.21.15.104:0/411407169 conn(0x7fa7040ccb40 msgr2=0x7fa7040ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.643+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd324005850 con 0x7fd33c0c83a0 2024-09-17T04:09:15.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1112416364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec15f630 msgr2=0x7f99ec15fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1112416364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec15f630 0x7f99ec15fa40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f99ec075150 tx=0x7f99e4032ad0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1112416364 shutdown_connections 2024-09-17T04:09:15.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1112416364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec15f630 0x7f99ec15fa40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1112416364 >> v2:172.21.15.192:3300/0 conn(0x7f99ec15ba80 0x7f99ec15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.646+0000 7fa70b415640 1 -- 172.21.15.104:0/411407169 shutdown_connections 2024-09-17T04:09:15.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.639+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1112416364 >> 172.21.15.104:0/1112416364 conn(0x7f99ec0cdca0 msgr2=0x7f99ec0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.643+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1112416364 shutdown_connections 2024-09-17T04:09:15.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.643+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1112416364 wait complete. 2024-09-17T04:09:15.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.646+0000 7f99f0fe6640 1 Processor -- start 2024-09-17T04:09:15.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.646+0000 7fa70b415640 1 -- 172.21.15.104:0/411407169 wait complete. 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.646+0000 7f99f0fe6640 1 -- start start 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.648+0000 7f99f0fe6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 0x7f99ec1f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99f0fe6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 0x7f99ec15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99f0fe6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec15f630 0x7f99ec158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99e9d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 0x7f99ec15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99e9d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 0x7f99ec15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:54938/0 (socket says 172.21.15.104:54938) 2024-09-17T04:09:15.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99e9d9b640 1 -- 172.21.15.104:0/1816792870 learned_addr learned my addr 172.21.15.104:0/1816792870 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec071690 con 0x7f99ec06f410 2024-09-17T04:09:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99ead9d640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec15f630 0x7f99ec158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec071510 con 0x7f99ec15ba80 2024-09-17T04:09:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.649+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec071810 con 0x7f99ec15f630 2024-09-17T04:09:15.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.650+0000 7fd3327fc640 1 -- 172.21.15.104:0/1973445665 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fd32c014410 con 0x7fd33c0c83a0 2024-09-17T04:09:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.651+0000 7fa70b415640 1 Processor -- start 2024-09-17T04:09:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.651+0000 7fa70b415640 1 -- start start 2024-09-17T04:09:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7fb6affff640 1 -- 172.21.15.104:0/3913168211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b008bb20 msgr2=0x7fb6b016b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7fb6affff640 1 --2- 172.21.15.104:0/3913168211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b008bb20 0x7fb6b016b340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb6b008b9f0 tx=0x7fb6a802cc90 comp rx=0 tx=0).stop 2024-09-17T04:09:15.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.650+0000 7f99ea59c640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 0x7f99ec1f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7f99ea59c640 1 -- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec15f630 msgr2=0x7f99ec158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7f99ea59c640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec15f630 0x7f99ec158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7f99ea59c640 1 -- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 msgr2=0x7f99ec15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7f99ea59c640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 0x7f99ec15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.652+0000 7f99ea59c640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec15add0 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.653+0000 7f99ea59c640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 0x7f99ec1f1c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c4d0 tx=0x7f99dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.653+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc017070 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.653+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99dc0035f0 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.655+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc003a40 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.655+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec156c80 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.655+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec156390 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.657+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99dc01a070 con 0x7f99ec06f410 2024-09-17T04:09:15.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.657+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f99dc01c780 con 0x7f99ec06f410 2024-09-17T04:09:15.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.659+0000 7f99d8ff9640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec0b5c10 con 0x7f99ec06f410 2024-09-17T04:09:15.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa70b415640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 0x7fa70420a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa7091b1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 0x7fa70420a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa7091b1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 0x7fa70420a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46544/0 (socket says 172.21.15.104:46544) 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa70b415640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7040b4980 0x7fa704166a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa7091b1640 1 -- 172.21.15.104:0/4095502528 learned_addr learned my addr 172.21.15.104:0/4095502528 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa70b415640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 0x7fa704165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa7089b0640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7040b4980 0x7fa704166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa70b415640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa704074560 con 0x7fa70406da40 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.667+0000 7fa7099b2640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 0x7fa704165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa70b415640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040743e0 con 0x7fa7040b4980 2024-09-17T04:09:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa70b415640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa7040746e0 con 0x7fa70416b730 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 -- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7040b4980 msgr2=0x7fa704166a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7040b4980 0x7fa704166a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 -- 172.21.15.104:0/4095502528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 msgr2=0x7fa70420a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 0x7fa70420a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70420acc0 con 0x7fa70416b730 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f99ec15add0 con 0x7f99ec06f410 2024-09-17T04:09:15.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa7099b2640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 0x7fa704165080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c730 tx=0x7fa6fc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.669+0000 7fcedaace640 1 -- 172.21.15.104:0/966397557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4162fa0 msgr2=0x7fced40d3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.669+0000 7fcedaace640 1 --2- 172.21.15.104:0/966397557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4162fa0 0x7fced40d3d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcec4005fd0 tx=0x7fcec402a520 comp rx=0 tx=0).stop 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.668+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc016020 con 0x7fa70416b730 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.669+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6fc00a930 con 0x7fa70416b730 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.669+0000 7fa70b415640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa704168bf0 con 0x7fa70416b730 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.669+0000 7fa70b415640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa704166210 con 0x7fa70416b730 2024-09-17T04:09:15.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.670+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00ad80 con 0x7fa70416b730 2024-09-17T04:09:15.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fcedaace640 1 -- 172.21.15.104:0/966397557 shutdown_connections 2024-09-17T04:09:15.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fcedaace640 1 --2- 172.21.15.104:0/966397557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced40d2f90 0x7fced40d33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fcedaace640 1 --2- 172.21.15.104:0/966397557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced4162fa0 0x7fced40d3d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fcedaace640 1 -- 172.21.15.104:0/966397557 >> 172.21.15.104:0/966397557 conn(0x7fced40d0fc0 msgr2=0x7fced40d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e4005290 con 0x7fa70416b730 2024-09-17T04:09:15.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6fc019020 con 0x7fa70416b730 2024-09-17T04:09:15.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.672+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa6fc01ba60 con 0x7fa70416b730 2024-09-17T04:09:15.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.673+0000 7fcedaace640 1 -- 172.21.15.104:0/966397557 shutdown_connections 2024-09-17T04:09:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.674+0000 7fb6affff640 1 -- 172.21.15.104:0/3913168211 shutdown_connections 2024-09-17T04:09:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.674+0000 7fb6affff640 1 --2- 172.21.15.104:0/3913168211 >> v2:172.21.15.192:3300/0 conn(0x7fb6b00b4fc0 0x7fb6b00cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.674+0000 7fb6affff640 1 --2- 172.21.15.104:0/3913168211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b006e530 0x7fb6b00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.674+0000 7fb6affff640 1 --2- 172.21.15.104:0/3913168211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b008bb20 0x7fb6b016b340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.674+0000 7fb6affff640 1 -- 172.21.15.104:0/3913168211 >> 172.21.15.104:0/3913168211 conn(0x7fb6b00cfec0 msgr2=0x7fb6b00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.675+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f63c0005850 con 0x7f63e006edf0 2024-09-17T04:09:15.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.673+0000 7fcedaace640 1 -- 172.21.15.104:0/966397557 wait complete. 2024-09-17T04:09:15.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.676+0000 7fcedaace640 1 Processor -- start 2024-09-17T04:09:15.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.676+0000 7fcedaace640 1 -- start start 2024-09-17T04:09:15.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 msgr2=0x7fd33c1f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd33c072d40 tx=0x7fd32c009cb0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fb6affff640 1 -- 172.21.15.104:0/3913168211 shutdown_connections 2024-09-17T04:09:15.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 shutdown_connections 2024-09-17T04:09:15.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd33c1f9740 0x7fd33c09a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd33c0c83a0 0x7fd33c1f9200 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 --2- 172.21.15.104:0/1973445665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd33c0c9090 0x7fd33c09cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 >> 172.21.15.104:0/1973445665 conn(0x7fd33c0b1b90 msgr2=0x7fd33c0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 shutdown_connections 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fd344238640 1 -- 172.21.15.104:0/1973445665 wait complete. 2024-09-17T04:09:15.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa6fc020020 con 0x7fa70416b730 2024-09-17T04:09:15.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.678+0000 7fb6affff640 1 -- 172.21.15.104:0/3913168211 wait complete. 2024-09-17T04:09:15.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.681+0000 7fb6affff640 1 Processor -- start 2024-09-17T04:09:15.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.682+0000 7fcedaace640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.682+0000 7fa193430640 1 -- 172.21.15.104:0/563297368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c15ac20 msgr2=0x7fa18c070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.682+0000 7fa193430640 1 --2- 172.21.15.104:0/563297368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c15ac20 0x7fa18c070070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa18400afd0 tx=0x7fa18402b540 comp rx=0 tx=0).stop 2024-09-17T04:09:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fced886a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fced886a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46556/0 (socket says 172.21.15.104:46556) 2024-09-17T04:09:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fced886a640 1 -- 172.21.15.104:0/2391909058 learned_addr learned my addr 172.21.15.104:0/2391909058 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced40d2f90 0x7fced4161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fa193430640 1 -- 172.21.15.104:0/563297368 shutdown_connections 2024-09-17T04:09:15.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fa193430640 1 --2- 172.21.15.104:0/563297368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c06ddf0 0x7fa18c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fa193430640 1 --2- 172.21.15.104:0/563297368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c15ac20 0x7fa18c070070 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa18400afd0 tx=0x7fa18402b540 comp rx=0 tx=0).stop 2024-09-17T04:09:15.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fa193430640 1 -- 172.21.15.104:0/563297368 >> 172.21.15.104:0/563297368 conn(0x7fa18c0b1b90 msgr2=0x7fa18c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.681+0000 7fb6affff640 1 -- start start 2024-09-17T04:09:15.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fb6affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 0x7fb6b015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fb6affff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 0x7fb6b016ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced4162fa0 0x7fced40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6affff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6b00b4fc0 0x7fb6b020b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 0x7fb6b015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6affff640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00ce4c0 con 0x7fb6b006e530 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 0x7fb6b015f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46558/0 (socket says 172.21.15.104:46558) 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6affff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00ce340 con 0x7fb6b00b4fc0 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6aeffd640 1 -- 172.21.15.104:0/1211950064 learned_addr learned my addr 172.21.15.104:0/1211950064 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6affff640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00ce640 con 0x7fb6b008bb20 2024-09-17T04:09:15.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.683+0000 7fced3fff640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced40d2f90 0x7fced4161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6ae7fc640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 0x7fb6b016ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fb6af7fe640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6b00b4fc0 0x7fb6b020b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fced409d640 con 0x7fced40cf710 2024-09-17T04:09:15.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fced906b640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced4162fa0 0x7fced40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fced40d0230 con 0x7fced40d2f90 2024-09-17T04:09:15.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.684+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fced40ca790 con 0x7fced4162fa0 2024-09-17T04:09:15.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.685+0000 7f63d5ffb640 1 -- 172.21.15.104:0/1982943183 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f63dc003c70 con 0x7f63e006edf0 2024-09-17T04:09:15.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.686+0000 7fb6ae7fc640 1 -- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6b00b4fc0 msgr2=0x7fb6b020b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.686+0000 7fb6ae7fc640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6b00b4fc0 0x7fb6b020b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.686+0000 7fb6ae7fc640 1 -- 172.21.15.104:0/1211950064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 msgr2=0x7fb6b015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.686+0000 7fb6ae7fc640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 0x7fb6b015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fb6ae7fc640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b01698c0 con 0x7fb6b008bb20 2024-09-17T04:09:15.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 -- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced4162fa0 msgr2=0x7fced40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced4162fa0 0x7fced40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 -- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced40d2f90 msgr2=0x7fced4161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced40d2f90 0x7fced4161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced40ce7c0 con 0x7fced40cf710 2024-09-17T04:09:15.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.688+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 msgr2=0x7f63e015fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.688+0000 7f63cb7fe640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097d0 tx=0x7f63dc030c50 comp rx=0 tx=0).stop 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.688+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 shutdown_connections 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.688+0000 7f63cb7fe640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e0209cc0 0x7f63e01569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.688+0000 7f63cb7fe640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e020e390 0x7f63e0159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7f63cb7fe640 1 --2- 172.21.15.104:0/1982943183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e006edf0 0x7f63e015fd40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 >> 172.21.15.104:0/1982943183 conn(0x7f63e006cde0 msgr2=0x7f63e0161990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fa193430640 1 -- 172.21.15.104:0/563297368 shutdown_connections 2024-09-17T04:09:15.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6ae7fc640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 0x7fb6b016ccf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00d0f90 tx=0x7fb6a000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 shutdown_connections 2024-09-17T04:09:15.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0015020 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7f63cb7fe640 1 -- 172.21.15.104:0/1982943183 wait complete. 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6a0011920 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011d70 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6affff640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b0169ba0 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6affff640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b020c630 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6a0018020 con 0x7fb6b008bb20 2024-09-17T04:09:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.689+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb6a0019890 con 0x7fb6b008bb20 2024-09-17T04:09:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.687+0000 7fced886a640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcec4034040 tx=0x7fcec40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.690+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec403e020 con 0x7fced40cf710 2024-09-17T04:09:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.690+0000 7fa193430640 1 -- 172.21.15.104:0/563297368 wait complete. 2024-09-17T04:09:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.690+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced40a1cf0 con 0x7fced40cf710 2024-09-17T04:09:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.690+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced40c8f30 con 0x7fced40cf710 2024-09-17T04:09:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.694+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb690005290 con 0x7fb6b008bb20 2024-09-17T04:09:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.696+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcec40035f0 con 0x7fced40cf710 2024-09-17T04:09:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.696+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4035070 con 0x7fced40cf710 2024-09-17T04:09:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.696+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb6a001f020 con 0x7fb6b008bb20 2024-09-17T04:09:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.697+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcec4041020 con 0x7fced40cf710 2024-09-17T04:09:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.698+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcec4043b50 con 0x7fced40cf710 2024-09-17T04:09:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.698+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced40d0750 con 0x7fced40cf710 2024-09-17T04:09:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.697+0000 7fa193430640 1 Processor -- start 2024-09-17T04:09:15.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.702+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcec4048030 con 0x7fced40cf710 2024-09-17T04:09:15.704 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.707+0000 7fa193430640 1 -- start start 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c06ddf0 0x7fa18c1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 0x7fa18c0a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c073f40 con 0x7fa18c06ddf0 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c070e80 con 0x7fa18c06ec50 2024-09-17T04:09:15.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fa193430640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c071000 con 0x7fa18c159d60 2024-09-17T04:09:15.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 -- 172.21.15.104:0/711202364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034e80 msgr2=0x7fcd98036d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 --2- 172.21.15.104:0/711202364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034e80 0x7fcd98036d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcda006c560 tx=0x7fcda00a6450 comp rx=0 tx=0).stop 2024-09-17T04:09:15.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:54970/0 (socket says 172.21.15.104:54970) 2024-09-17T04:09:15.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 -- 172.21.15.104:0/565290031 learned_addr learned my addr 172.21.15.104:0/565290031 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7f7c2f669640 1 -- 172.21.15.104:0/3966871342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28074b40 msgr2=0x7f7c2816c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7f7c2f669640 1 --2- 172.21.15.104:0/3966871342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28074b40 0x7f7c2816c110 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c240092b0 tx=0x7f7c2402e930 comp rx=0 tx=0).stop 2024-09-17T04:09:15.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7f7c2f669640 1 -- 172.21.15.104:0/3966871342 shutdown_connections 2024-09-17T04:09:15.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 -- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 msgr2=0x7fa18c0a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1919cd640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 0x7fa18c0a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 0x7fa18c0a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 -- 172.21.15.104:0/565290031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c06ddf0 msgr2=0x7fa18c1e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c06ddf0 0x7fa18c1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fa1909cb640 1 -- 172.21.15.104:0/565290031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c1e8690 con 0x7fa18c06ec50 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.712+0000 7fa1909cb640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e790 tx=0x7fa18800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.712+0000 7fa1919cd640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 0x7fa18c0a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.707+0000 7fb871694640 1 -- 172.21.15.104:0/3877964564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c06edf0 msgr2=0x7fb86c16ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.707+0000 7fb871694640 1 --2- 172.21.15.104:0/3877964564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c06edf0 0x7fb86c16ec10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0727b0 tx=0x7fb85802a4b0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.709+0000 7fb871694640 1 -- 172.21.15.104:0/3877964564 shutdown_connections 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.710+0000 7fb871694640 1 --2- 172.21.15.104:0/3877964564 >> v2:172.21.15.104:3300/0 conn(0x7fb86c06f200 0x7fb86c16f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.710+0000 7fb871694640 1 --2- 172.21.15.104:0/3877964564 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c06edf0 0x7fb86c16ec10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.710+0000 7fb871694640 1 --2- 172.21.15.104:0/3877964564 >> v2:172.21.15.192:3300/0 conn(0x7fb86c073070 0x7fb86c08b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.710+0000 7fb871694640 1 -- 172.21.15.104:0/3877964564 >> 172.21.15.104:0/3877964564 conn(0x7fb86c06cde0 msgr2=0x7fb86c06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.712+0000 7fb871694640 1 -- 172.21.15.104:0/3877964564 shutdown_connections 2024-09-17T04:09:15.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.712+0000 7fb871694640 1 -- 172.21.15.104:0/3877964564 wait complete. 2024-09-17T04:09:15.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.715+0000 7fb871694640 1 Processor -- start 2024-09-17T04:09:15.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.715+0000 7fb871694640 1 -- start start 2024-09-17T04:09:15.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800eea0 con 0x7fa18c06ec50 2024-09-17T04:09:15.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa18800cdb0 con 0x7fa18c06ec50 2024-09-17T04:09:15.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188010690 con 0x7fa18c06ec50 2024-09-17T04:09:15.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c0b3b30 con 0x7fa18c06ec50 2024-09-17T04:09:15.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.717+0000 7fb871694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c0b4550 con 0x7fa18c06ec50 2024-09-17T04:09:15.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa188010830 con 0x7fa18c06ec50 2024-09-17T04:09:15.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.718+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1880213f0 con 0x7fa18c06ec50 2024-09-17T04:09:15.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.719+0000 7f7c2f669640 1 --2- 172.21.15.104:0/3966871342 >> v2:172.21.15.104:3300/0 conn(0x7f7c2816c650 0x7f7c2806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.719+0000 7f7c2f669640 1 --2- 172.21.15.104:0/3966871342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28074b40 0x7f7c2816c110 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c240092b0 tx=0x7f7c2402e930 comp rx=0 tx=0).stop 2024-09-17T04:09:15.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.719+0000 7f7c2f669640 1 -- 172.21.15.104:0/3966871342 >> 172.21.15.104:0/3966871342 conn(0x7f7c280b1b90 msgr2=0x7f7c280b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.719+0000 7f7c2f669640 1 -- 172.21.15.104:0/3966871342 shutdown_connections 2024-09-17T04:09:15.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.719+0000 7f7c2f669640 1 -- 172.21.15.104:0/3966871342 wait complete. 2024-09-17T04:09:15.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.721+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c005290 con 0x7fa18c06ec50 2024-09-17T04:09:15.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 -- 172.21.15.104:0/711202364 shutdown_connections 2024-09-17T04:09:15.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 --2- 172.21.15.104:0/711202364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98052b00 0x7fcd98052f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 --2- 172.21.15.104:0/711202364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034e80 0x7fcd98036d80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 --2- 172.21.15.104:0/711202364 >> v2:172.21.15.192:3300/0 conn(0x7fcd98034a70 0x7fcd98036840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.711+0000 7fcda5997640 1 -- 172.21.15.104:0/711202364 >> 172.21.15.104:0/711202364 conn(0x7fcd9801e260 msgr2=0x7fcd98039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.722+0000 7f7c2f669640 1 Processor -- start 2024-09-17T04:09:15.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb86affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb86affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46580/0 (socket says 172.21.15.104:46580) 2024-09-17T04:09:15.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb86affd640 1 -- 172.21.15.104:0/3382985945 learned_addr learned my addr 172.21.15.104:0/3382985945 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 0x7fb86c161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 0x7fb86c15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c16bd20 con 0x7fb86c06edf0 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb86b7fe640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 0x7fb86c15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c16bba0 con 0x7fb86c06f200 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb86c16bea0 con 0x7fb86c073070 2024-09-17T04:09:15.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fb86a7fc640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 0x7fb86c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.724+0000 7fb86affd640 1 -- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 msgr2=0x7fb86c15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.724+0000 7fb86affd640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 0x7fb86c15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.724+0000 7fb86affd640 1 -- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 msgr2=0x7fb86c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.724+0000 7fb86affd640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 0x7fb86c161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.724+0000 7fb86affd640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86c0cf7f0 con 0x7fb86c06edf0 2024-09-17T04:09:15.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.725+0000 7f7c2f669640 1 -- start start 2024-09-17T04:09:15.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.725+0000 7fb86affd640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00ea30 tx=0x7fb85c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fcda5997640 1 -- 172.21.15.104:0/711202364 shutdown_connections 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.723+0000 7fcda5997640 1 -- 172.21.15.104:0/711202364 wait complete. 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fcda5997640 1 Processor -- start 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fb86a7fc640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 0x7fb86c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fb86b7fe640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 0x7fb86c15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00cc30 con 0x7fb86c06edf0 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb85c00cdf0 con 0x7fb86c06edf0 2024-09-17T04:09:15.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c1631b0 con 0x7fb86c06edf0 2024-09-17T04:09:15.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.726+0000 7fcda5997640 1 -- start start 2024-09-17T04:09:15.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.728+0000 7fcda5997640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda4995640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda4995640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46582/0 (socket says 172.21.15.104:46582) 2024-09-17T04:09:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7f7c2f669640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 0x7f7c280b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda4995640 1 -- 172.21.15.104:0/1852113106 learned_addr learned my addr 172.21.15.104:0/1852113106 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98034e80 0x7fcd98032680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.731 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7f7c2f669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 0x7f7c28206100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd98052b00 0x7fcd98032bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcd980538c0 con 0x7fcd98034a70 2024-09-17T04:09:15.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98053740 con 0x7fcd98052b00 2024-09-17T04:09:15.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcd98053a40 con 0x7fcd98034e80 2024-09-17T04:09:15.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa188010b20 con 0x7fa18c06ec50 2024-09-17T04:09:15.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.729+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c163770 con 0x7fb86c06edf0 2024-09-17T04:09:15.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c005260 con 0x7fb86c06edf0 2024-09-17T04:09:15.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb85c0047a0 con 0x7fb86c06edf0 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb85c010770 con 0x7fb86c06edf0 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.733+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb848005290 con 0x7fb86c06edf0 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2d405640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 0x7f7c280b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2d405640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 0x7f7c280b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:54992/0 (socket says 172.21.15.104:54992) 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2d405640 1 -- 172.21.15.104:0/453844640 learned_addr learned my addr 172.21.15.104:0/453844640 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2cc04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 0x7f7c28206100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2f669640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28206640 0x7f7c2809ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2806e330 con 0x7f7c2816f040 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.731+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28072fa0 con 0x7f7c2816c650 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.731+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2806e4b0 con 0x7f7c28206640 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.731+0000 7f7c2dc06640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28206640 0x7f7c2809ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7f7c2cc04640 1 -- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28206640 msgr2=0x7f7c2809ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7f7c2cc04640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28206640 0x7f7c2809ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7f7c2cc04640 1 -- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 msgr2=0x7f7c280b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7f7c2cc04640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 0x7f7c280b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7f7c2cc04640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c280b5e20 con 0x7f7c2816f040 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7fcd9ffff640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98034e80 0x7fcd98032680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.730+0000 7fcda5196640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd98052b00 0x7fcd98032bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 -- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98034e80 msgr2=0x7fcd98032680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98034e80 0x7fcd98032680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 -- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd98052b00 msgr2=0x7fcd98032bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd98052b00 0x7fcd98032bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd98049240 con 0x7fcd98034a70 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.734+0000 7fcda4995640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b780 tx=0x7fcd9400bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.735+0000 7f7c2cc04640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 0x7f7c28206100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c24036000 tx=0x7f7c24035bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94019070 con 0x7fcd98034a70 2024-09-17T04:09:15.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd9400c810 con 0x7fcd98034a70 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd98049520 con 0x7fcd98034a70 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9804b7d0 con 0x7fcd98034a70 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400cc40 con 0x7fcd98034a70 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24038020 con 0x7f7c2816f040 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c240035f0 con 0x7f7c2816f040 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.737+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c28206a50 con 0x7f7c2816f040 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.738+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c280b3df0 con 0x7f7c2816f040 2024-09-17T04:09:15.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.738+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24003a00 con 0x7f7c2816f040 2024-09-17T04:09:15.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.739+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd9401c070 con 0x7fcd98034a70 2024-09-17T04:09:15.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.739+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd940147d0 con 0x7fcd98034a70 2024-09-17T04:09:15.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.739+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c2403b020 con 0x7f7c2816f040 2024-09-17T04:09:15.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.739+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c2403dd10 con 0x7f7c2816f040 2024-09-17T04:09:15.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.741+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd80005290 con 0x7fcd98034a70 2024-09-17T04:09:15.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 -- 172.21.15.104:0/791433292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c072f90 msgr2=0x7f210c15f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 --2- 172.21.15.104:0/791433292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c072f90 0x7f210c15f5b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2104005fd0 tx=0x7f210402a9a0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 -- 172.21.15.104:0/791433292 shutdown_connections 2024-09-17T04:09:15.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 --2- 172.21.15.104:0/791433292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c15faf0 0x7f210c162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 --2- 172.21.15.104:0/791433292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c072f90 0x7f210c15f5b0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2104005fd0 tx=0x7f210402a9a0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f2113cb4640 1 -- 172.21.15.104:0/791433292 >> 172.21.15.104:0/791433292 conn(0x7f210c0b1b90 msgr2=0x7f210c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c08005290 con 0x7f7c2816f040 2024-09-17T04:09:15.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.745+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcd94014a20 con 0x7fcd98034a70 2024-09-17T04:09:15.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.742+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb85c026070 con 0x7fb86c06edf0 2024-09-17T04:09:15.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.750+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c28206a50 con 0x7f7c2816f040 2024-09-17T04:09:15.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.753+0000 7f2113cb4640 1 -- 172.21.15.104:0/791433292 shutdown_connections 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.757+0000 7f2113cb4640 1 -- 172.21.15.104:0/791433292 wait complete. 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.760+0000 7f2113cb4640 1 Processor -- start 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.760+0000 7f2113cb4640 1 -- start start 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2111a50640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2111a50640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46594/0 (socket says 172.21.15.104:46594) 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2111a50640 1 -- 172.21.15.104:0/2713251062 learned_addr learned my addr 172.21.15.104:0/2713251062 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 0x7f210c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 0x7f210c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f210c06e180 con 0x7f210c0aee70 2024-09-17T04:09:15.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f210c06e000 con 0x7f210c15faf0 2024-09-17T04:09:15.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f210c06e300 con 0x7f210c0b55a0 2024-09-17T04:09:15.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f211124f640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 0x7f210c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.762+0000 7f2112251640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 0x7f210c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 -- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 msgr2=0x7f210c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 0x7f210c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 -- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 msgr2=0x7f210c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 0x7f210c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c09e380 con 0x7f210c0aee70 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2111a50640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00b7b0 tx=0x7f20fc00bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f211124f640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 0x7f210c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.763+0000 7f2112251640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 0x7f210c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.764+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc019070 con 0x7f210c0aee70 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.764+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20fc00c830 con 0x7f210c0aee70 2024-09-17T04:09:15.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.764+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00cc80 con 0x7f210c0aee70 2024-09-17T04:09:15.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.765+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c0b5cb0 con 0x7f210c0aee70 2024-09-17T04:09:15.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.765+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20fc014440 con 0x7f210c0aee70 2024-09-17T04:09:15.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.766+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c0b3400 con 0x7f210c0aee70 2024-09-17T04:09:15.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.766+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f20fc014910 con 0x7f210c0aee70 2024-09-17T04:09:15.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.768+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c0b6020 con 0x7f210c0aee70 2024-09-17T04:09:15.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 -- 172.21.15.104:0/4178758884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821000b9a0 msgr2=0x7f821000ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 --2- 172.21.15.104:0/4178758884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821000b9a0 0x7f821000ddc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f821c001b20 tx=0x7f8210003980 comp rx=0 tx=0).stop 2024-09-17T04:09:15.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f82277fe640 1 -- 172.21.15.104:0/4178758884 reap_dead start 2024-09-17T04:09:15.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 -- 172.21.15.104:0/4178758884 shutdown_connections 2024-09-17T04:09:15.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 -- 172.21.15.104:0/4178758884 >> 172.21.15.104:0/4178758884 conn(0x7f82280cfec0 msgr2=0x7f82280d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f20fc023070 con 0x7f210c0aee70 2024-09-17T04:09:15.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 -- 172.21.15.104:0/4178758884 shutdown_connections 2024-09-17T04:09:15.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.773+0000 7f8227fff640 1 -- 172.21.15.104:0/4178758884 wait complete. 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.777+0000 7f8227fff640 1 Processor -- start 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.777+0000 7f8227fff640 1 -- start start 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82280ab0b0 0x7f82280aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8228166280 0x7f82280a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f822806d6d0 con 0x7f82280cb8c0 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f822816b7c0 con 0x7f8228166280 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f8227fff640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f822806d850 con 0x7f82280ab0b0 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f82267fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.779+0000 7f82267fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46598/0 (socket says 172.21.15.104:46598) 2024-09-17T04:09:15.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 -- 172.21.15.104:0/3930952335 learned_addr learned my addr 172.21.15.104:0/3930952335 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82277fe640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8228166280 0x7f82280a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 -- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82280ab0b0 msgr2=0x7f82280aa330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82280ab0b0 0x7f82280aa330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 -- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8228166280 msgr2=0x7f82280a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8228166280 0x7f82280a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 -- 172.21.15.104:0/3930952335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82280ab590 con 0x7f82280cb8c0 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.780+0000 7f82267fc640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f822000cc30 tx=0x7f822000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:15.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.781+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220016020 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.781+0000 7f8227fff640 1 -- 172.21.15.104:0/3930952335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82280ab870 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.781+0000 7f8227fff640 1 -- 172.21.15.104:0/3930952335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8228165540 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.783+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8220012420 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.783+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220012830 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.783+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8220019020 con 0x7f82280cb8c0 2024-09-17T04:09:15.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.783+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f822001a3b0 con 0x7f82280cb8c0 2024-09-17T04:09:15.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.785+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8208005290 con 0x7f82280cb8c0 2024-09-17T04:09:15.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.793+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8220020020 con 0x7f82280cb8c0 2024-09-17T04:09:15.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.804+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f667006d9b0 con 0x7f6658003b90 2024-09-17T04:09:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.810+0000 7f666d7fa640 1 -- 172.21.15.104:0/3933738679 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f666805f950 con 0x7f6658003b90 2024-09-17T04:09:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 msgr2=0x7f66701f0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f666804cf10 tx=0x7f6668006830 comp rx=0 tx=0).stop 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 shutdown_connections 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66700b4ee0 0x7f667015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667008a9e0 0x7f66700b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 --2- 172.21.15.104:0/3933738679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6658003b90 0x7f66701f0460 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 >> 172.21.15.104:0/3933738679 conn(0x7f66700735d0 msgr2=0x7f66700b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 shutdown_connections 2024-09-17T04:09:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.812+0000 7f6656ffd640 1 -- 172.21.15.104:0/3933738679 wait complete. 2024-09-17T04:09:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.835+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f9a6c005850 con 0x7f9a84053c50 2024-09-17T04:09:15.836 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.846+0000 7f99d8ff9640 1 -- 172.21.15.104:0/1816792870 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f99ec15dd40 con 0x7f99ec06f410 2024-09-17T04:09:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.853+0000 7f99daffd640 1 -- 172.21.15.104:0/1816792870 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 111+0+0 (secure 0 0 0) 0x7f99dc003be0 con 0x7f99ec06f410 2024-09-17T04:09:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.858+0000 7f9a88ff9640 1 -- 172.21.15.104:0/968455807 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7f9a8c0ada60 con 0x7f9a84053c50 2024-09-17T04:09:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 msgr2=0x7f9a84186b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f9a767fc640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c06bfc0 tx=0x7f9a8c0ac430 comp rx=0 tx=0).stop 2024-09-17T04:09:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 msgr2=0x7f99ec1f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 0x7f99ec1f1c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c4d0 tx=0x7f99dc00c990 comp rx=0 tx=0).stop 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 shutdown_connections 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec15ba80 0x7f99ec15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec15f630 0x7f99ec158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 --2- 172.21.15.104:0/1816792870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec06f410 0x7f99ec1f1c70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.859+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 >> 172.21.15.104:0/1816792870 conn(0x7f99ec0cdca0 msgr2=0x7f99ec0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 shutdown_connections 2024-09-17T04:09:15.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f9a767fc640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84056da0 0x7f9a8418a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f9a767fc640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a840e2f40 0x7f9a8418ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f9a767fc640 1 --2- 172.21.15.104:0/968455807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a84053c50 0x7f9a84186b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 >> 172.21.15.104:0/968455807 conn(0x7f9a8403a5f0 msgr2=0x7f9a8400e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 shutdown_connections 2024-09-17T04:09:15.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.860+0000 7f99f0fe6640 1 -- 172.21.15.104:0/1816792870 wait complete. 2024-09-17T04:09:15.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.863+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 shutdown_connections 2024-09-17T04:09:15.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.863+0000 7f9a767fc640 1 -- 172.21.15.104:0/968455807 wait complete. 2024-09-17T04:09:15.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.867+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fb020005580 con 0x7fb03c0b05c0 2024-09-17T04:09:15.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.876+0000 7fb02affd640 1 -- 172.21.15.104:0/2074572628 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fb0340070d0 con 0x7fb03c0b05c0 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 msgr2=0x7fb03c212340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb0340039f0 tx=0x7fb034001f00 comp rx=0 tx=0).stop 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 shutdown_connections 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c2169c0 0x7fb03c0a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb03c216070 0x7fb03c216480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 --2- 172.21.15.104:0/2074572628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c0b05c0 0x7fb03c212340 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 >> 172.21.15.104:0/2074572628 conn(0x7fb03c0cfec0 msgr2=0x7fb03c06d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 shutdown_connections 2024-09-17T04:09:15.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.883+0000 7fb028ff9640 1 -- 172.21.15.104:0/2074572628 wait complete. 2024-09-17T04:09:15.899 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.909+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fa6e4005850 con 0x7fa70416b730 2024-09-17T04:09:15.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.916+0000 7fa6f9ffb640 1 -- 172.21.15.104:0/4095502528 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7fa70420acc0 con 0x7fa70416b730 2024-09-17T04:09:15.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.916+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb690005580 con 0x7fb6b008bb20 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 msgr2=0x7fa704165080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 0x7fa704165080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c730 tx=0x7fa6fc00cbf0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 shutdown_connections 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7040b4980 0x7fa704166a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa70416b730 0x7fa704165080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 --2- 172.21.15.104:0/4095502528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa70406da40 0x7fa70420a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 >> 172.21.15.104:0/4095502528 conn(0x7fa7040ccb40 msgr2=0x7fa70416e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 shutdown_connections 2024-09-17T04:09:15.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.918+0000 7fa6ef7fe640 1 -- 172.21.15.104:0/4095502528 wait complete. 2024-09-17T04:09:15.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.922+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fced40cfbc0 con 0x7fced40cf710 2024-09-17T04:09:15.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.923+0000 7fb6977fe640 1 -- 172.21.15.104:0/1211950064 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7fb6a0019ae0 con 0x7fb6b008bb20 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.924+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 msgr2=0x7fb6b016ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.924+0000 7fb6957fa640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 0x7fb6b016ccf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00d0f90 tx=0x7fb6a000b870 comp rx=0 tx=0).stop 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 shutdown_connections 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6b00b4fc0 0x7fb6b020b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6b008bb20 0x7fb6b016ccf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 --2- 172.21.15.104:0/1211950064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6b006e530 0x7fb6b015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 >> 172.21.15.104:0/1211950064 conn(0x7fb6b00cfec0 msgr2=0x7fb6b01613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 shutdown_connections 2024-09-17T04:09:15.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.925+0000 7fb6957fa640 1 -- 172.21.15.104:0/1211950064 wait complete. 2024-09-17T04:09:15.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.933+0000 7fced17fa640 1 -- 172.21.15.104:0/2391909058 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7fcec4043400 con 0x7fced40cf710 2024-09-17T04:09:15.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.934+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 msgr2=0x7fced40cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.934+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcec4034040 tx=0x7fcec40049d0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 shutdown_connections 2024-09-17T04:09:15.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fced40d2f90 0x7fced4161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fced4162fa0 0x7fced40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 --2- 172.21.15.104:0/2391909058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fced40cf710 0x7fced40cbff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 >> 172.21.15.104:0/2391909058 conn(0x7fced40d0fc0 msgr2=0x7fced406f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.935+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 shutdown_connections 2024-09-17T04:09:15.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.936+0000 7fcedaace640 1 -- 172.21.15.104:0/2391909058 wait complete. 2024-09-17T04:09:15.959 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.959 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.959 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.959+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa16c005850 con 0x7fa18c06ec50 2024-09-17T04:09:15.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.964+0000 7fa181ffb640 1 -- 172.21.15.104:0/565290031 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fa188010d00 con 0x7fa18c06ec50 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.965+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 msgr2=0x7fa18c1e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.965+0000 7fa193430640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e790 tx=0x7fa18800ec50 comp rx=0 tx=0).stop 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 shutdown_connections 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa18c06ec50 0x7fa18c1e7b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa18c159d60 0x7fa18c0a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 --2- 172.21.15.104:0/565290031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa18c06ddf0 0x7fa18c1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 >> 172.21.15.104:0/565290031 conn(0x7fa18c0b1b90 msgr2=0x7fa18c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 shutdown_connections 2024-09-17T04:09:15.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.966+0000 7fa193430640 1 -- 172.21.15.104:0/565290031 wait complete. 2024-09-17T04:09:15.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.968+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f8208005580 con 0x7f82280cb8c0 2024-09-17T04:09:15.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.968+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f210c161520 con 0x7f210c0aee70 2024-09-17T04:09:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.971+0000 7f21027fc640 1 -- 172.21.15.104:0/2713251062 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f20fc014b10 con 0x7f210c0aee70 2024-09-17T04:09:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 msgr2=0x7f210c0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00b7b0 tx=0x7f20fc00bc70 comp rx=0 tx=0).stop 2024-09-17T04:09:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 shutdown_connections 2024-09-17T04:09:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f210c15faf0 0x7f210c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f210c0b55a0 0x7f210c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 --2- 172.21.15.104:0/2713251062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f210c0aee70 0x7f210c0b5060 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 >> 172.21.15.104:0/2713251062 conn(0x7f210c0b1b90 msgr2=0x7f210c0b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 shutdown_connections 2024-09-17T04:09:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7f2113cb4640 1 -- 172.21.15.104:0/2713251062 wait complete. 2024-09-17T04:09:15.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.972+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fb848005580 con 0x7fb86c06edf0 2024-09-17T04:09:15.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.974+0000 7f820f7fe640 1 -- 172.21.15.104:0/3930952335 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f822001b4e0 con 0x7f82280cb8c0 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 msgr2=0x7f8228165d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f822000cc30 tx=0x7f822000a430 comp rx=0 tx=0).stop 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 shutdown_connections 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8228166280 0x7f82280a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82280cb8c0 0x7f8228165d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 --2- 172.21.15.104:0/3930952335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82280ab0b0 0x7f82280aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 >> 172.21.15.104:0/3930952335 conn(0x7f82280cfec0 msgr2=0x7f82280b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 shutdown_connections 2024-09-17T04:09:15.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.976+0000 7f820d7fa640 1 -- 172.21.15.104:0/3930952335 wait complete. 2024-09-17T04:09:15.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.978+0000 7fb8637fe640 1 -- 172.21.15.104:0/3382985945 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7fb85c004c70 con 0x7fb86c06edf0 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 msgr2=0x7fb86c160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00ea30 tx=0x7fb85c00eef0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 shutdown_connections 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb86c06f200 0x7fb86c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb86c073070 0x7fb86c15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 --2- 172.21.15.104:0/3382985945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb86c06edf0 0x7fb86c160fd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 >> 172.21.15.104:0/3382985945 conn(0x7fb86c06cde0 msgr2=0x7fb86c06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.979+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 shutdown_connections 2024-09-17T04:09:15.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.980+0000 7fb871694640 1 -- 172.21.15.104:0/3382985945 wait complete. 2024-09-17T04:09:15.981 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.981 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.981 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi104') 2024-09-17T04:09:15.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.981+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fcd80005580 con 0x7fcd98034a70 2024-09-17T04:09:15.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.984+0000 7fcd9d7fa640 1 -- 172.21.15.104:0/1852113106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7fcd94014c00 con 0x7fcd98034a70 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 msgr2=0x7fcd980e4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b780 tx=0x7fcd9400bc40 comp rx=0 tx=0).stop 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 shutdown_connections 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd98052b00 0x7fcd98032bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd98034e80 0x7fcd98032680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 --2- 172.21.15.104:0/1852113106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd98034a70 0x7fcd980e4510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 >> 172.21.15.104:0/1852113106 conn(0x7fcd9801e260 msgr2=0x7fcd980e4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 shutdown_connections 2024-09-17T04:09:15.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.986+0000 7fcda5997640 1 -- 172.21.15.104:0/1852113106 wait complete. 2024-09-17T04:09:15.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.989+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f7c080058c0 con 0x7f7c2816f040 2024-09-17T04:09:15.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.992+0000 7f7c19ffb640 1 -- 172.21.15.104:0/453844640 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f7c280b5e20 con 0x7f7c2816f040 2024-09-17T04:09:15.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.993+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 msgr2=0x7f7c28206100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.993+0000 7f7c2f669640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 0x7f7c28206100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c24036000 tx=0x7f7c24035bc0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.993+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 shutdown_connections 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c28206640 0x7f7c2809ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c2816f040 0x7f7c28206100 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 --2- 172.21.15.104:0/453844640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c2816c650 0x7f7c280b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:15.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 >> 172.21.15.104:0/453844640 conn(0x7f7c280b1b90 msgr2=0x7f7c280cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:15.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 shutdown_connections 2024-09-17T04:09:15.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:15.994+0000 7f7c2f669640 1 -- 172.21.15.104:0/453844640 wait complete. 2024-09-17T04:09:15.998 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2024-09-17T04:09:16.006 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi104') 2024-09-17T04:09:16.006 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi104') 2024-09-17T04:09:16.006 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T04:09:16.007 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config dump 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 -- 172.21.15.104:0/1112953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 msgr2=0x7f074415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 --2- 172.21.15.104:0/1112953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f074415b350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07440ce420 tx=0x7f073402a560 comp rx=0 tx=0).stop 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 -- 172.21.15.104:0/1112953913 shutdown_connections 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 --2- 172.21.15.104:0/1112953913 >> v2:172.21.15.192:3300/0 conn(0x7f074415fc70 0x7f07440b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 --2- 172.21.15.104:0/1112953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f074415b350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 -- 172.21.15.104:0/1112953913 >> 172.21.15.104:0/1112953913 conn(0x7f0744073e30 msgr2=0x7f0744074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 -- 172.21.15.104:0/1112953913 shutdown_connections 2024-09-17T04:09:16.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.157+0000 7f074a550640 1 -- 172.21.15.104:0/1112953913 wait complete. 2024-09-17T04:09:16.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.159+0000 7f074a550640 1 Processor -- start 2024-09-17T04:09:16.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.159+0000 7f074a550640 1 -- start start 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.160+0000 7f074a550640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 0x7f074406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f074415fc70 0x7f074406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07440b4990 con 0x7f07440cee70 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f07440b4810 con 0x7f074415f150 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f07440b4b10 con 0x7f074415fc70 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46616/0 (socket says 172.21.15.104:46616) 2024-09-17T04:09:16.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 -- 172.21.15.104:0/3241363148 learned_addr learned my addr 172.21.15.104:0/3241363148 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f07437fe640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 0x7f074406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0748aed640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f074415fc70 0x7f074406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 -- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f074415fc70 msgr2=0x7f074406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f074415fc70 0x7f074406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 -- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 msgr2=0x7f074406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 0x7f074406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 -- 172.21.15.104:0/3241363148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07441f44d0 con 0x7f07440cee70 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f07437fe640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 0x7f074406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0743fff640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0734034040 tx=0x7f0734003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073403e030 con 0x7f07440cee70 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734003d10 con 0x7f07440cee70 2024-09-17T04:09:16.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734035040 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.161+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07441e8680 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.162+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441f39f0 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.162+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0734041030 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.162+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0734043bf0 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.163+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07440b4fc0 con 0x7f07440cee70 2024-09-17T04:09:16.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.165+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0734043410 con 0x7f07440cee70 2024-09-17T04:09:16.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.236+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f07440b5850 con 0x7f07440cee70 2024-09-17T04:09:16.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.237+0000 7f0740ff9640 1 -- 172.21.15.104:0/3241363148 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f0734004f30 con 0x7f07440cee70 2024-09-17T04:09:16.237 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T04:09:16.237 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T04:09:16.237 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T04:09:16.238 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T04:09:16.239 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 msgr2=0x7f07441e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0734034040 tx=0x7f0734003820 comp rx=0 tx=0).stop 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 shutdown_connections 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f074415f150 0x7f074406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f074415fc70 0x7f074406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 --2- 172.21.15.104:0/3241363148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07440cee70 0x7f07441e8140 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 >> 172.21.15.104:0/3241363148 conn(0x7f0744073e30 msgr2=0x7f07440b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:16.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 shutdown_connections 2024-09-17T04:09:16.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.238+0000 7f074a550640 1 -- 172.21.15.104:0/3241363148 wait complete. 2024-09-17T04:09:16.248 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T04:09:16.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 -- 172.21.15.104:0/3654291184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72200705b0 msgr2=0x7f72200cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 --2- 172.21.15.104:0/3654291184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72200705b0 0x7f72200cdc70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7218005fd0 tx=0x7f721802b8f0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 -- 172.21.15.104:0/3654291184 shutdown_connections 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 --2- 172.21.15.104:0/3654291184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72200705b0 0x7f72200cdc70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 --2- 172.21.15.104:0/3654291184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f722006fc60 0x7f7220070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 -- 172.21.15.104:0/3654291184 >> 172.21.15.104:0/3654291184 conn(0x7f72200b1b90 msgr2=0x7f72200b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 -- 172.21.15.104:0/3654291184 shutdown_connections 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.360+0000 7f722721d640 1 -- 172.21.15.104:0/3654291184 wait complete. 2024-09-17T04:09:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.362+0000 7f722721d640 1 Processor -- start 2024-09-17T04:09:16.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.362+0000 7f722721d640 1 -- start start 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f722006fc60 0x7f72201f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 0x7f72201e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f722006e320 con 0x7f7220074b00 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f722006e1a0 con 0x7f722006fc60 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f722721d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f722006e4a0 con 0x7f72200705b0 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f72257ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f72257ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35730/0 (socket says 172.21.15.104:35730) 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f72257ba640 1 -- 172.21.15.104:0/1552039499 learned_addr learned my addr 172.21.15.104:0/1552039499 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 0x7f72201e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f7224fb9640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f722006fc60 0x7f72201f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 -- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f722006fc60 msgr2=0x7f72201f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f722006fc60 0x7f72201f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 -- 172.21.15.104:0/1552039499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 msgr2=0x7f722015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 -- 172.21.15.104:0/1552039499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72201f6290 con 0x7f72200705b0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f72257ba640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.364+0000 7f721ffff640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 0x7f72201e9130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e6d0 tx=0x7f720c00eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c00cab0 con 0x7f72200705b0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f720c00cd40 con 0x7f72200705b0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c010690 con 0x7f72200705b0 2024-09-17T04:09:16.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72201e41e0 con 0x7f72200705b0 2024-09-17T04:09:16.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72201f66e0 con 0x7f72200705b0 2024-09-17T04:09:16.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f720c010830 con 0x7f72200705b0 2024-09-17T04:09:16.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.365+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f720c018c60 con 0x7f72200705b0 2024-09-17T04:09:16.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.366+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7220070070 con 0x7f72200705b0 2024-09-17T04:09:16.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.368+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f72201f6290 con 0x7f72200705b0 2024-09-17T04:09:16.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.432+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f72200cc350 con 0x7f72200705b0 2024-09-17T04:09:16.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.436+0000 7f721d7fa640 1 -- 172.21.15.104:0/1552039499 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f720c010cb0 con 0x7f72200705b0 2024-09-17T04:09:16.436 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 msgr2=0x7f72201e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 0x7f72201e9130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e6d0 tx=0x7f720c00eb90 comp rx=0 tx=0).stop 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 shutdown_connections 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7220074b00 0x7f722015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72200705b0 0x7f72201e9130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 --2- 172.21.15.104:0/1552039499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f722006fc60 0x7f72201f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 >> 172.21.15.104:0/1552039499 conn(0x7f72200b1b90 msgr2=0x7f72200b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 shutdown_connections 2024-09-17T04:09:16.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:16.437+0000 7f722721d640 1 -- 172.21.15.104:0/1552039499 wait complete. 2024-09-17T04:09:16.447 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T04:09:16.447 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T04:09:16.448 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:16.448 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T04:09:16.472 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:16.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T04:09:16.537 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:16.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T04:09:16.602 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:16.602 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T04:09:16.666 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:16.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T04:09:16.691 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:16.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T04:09:16.757 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:16.757 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T04:09:16.823 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:09:16.823 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T04:09:16.888 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new ae881500-83ef-4908-9d85-0d96fc0637e9 0 2024-09-17T04:09:17.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 -- 172.21.15.192:0/3213916023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 msgr2=0x7efc3015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 --2- 172.21.15.192:0/3213916023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc3015ba80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efc3006e6e0 tx=0x7efc2c02a540 comp rx=0 tx=0).stop 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 -- 172.21.15.192:0/3213916023 shutdown_connections 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 --2- 172.21.15.192:0/3213916023 >> v2:172.21.15.104:3300/0 conn(0x7efc3015bfc0 0x7efc3015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 --2- 172.21.15.192:0/3213916023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc3015ba80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 --2- 172.21.15.192:0/3213916023 >> v2:172.21.15.192:3300/0 conn(0x7efc3006def0 0x7efc3006f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 -- 172.21.15.192:0/3213916023 >> 172.21.15.192:0/3213916023 conn(0x7efc300cdca0 msgr2=0x7efc300ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 -- 172.21.15.192:0/3213916023 shutdown_connections 2024-09-17T04:09:17.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.041+0000 7efc384de640 1 -- 172.21.15.192:0/3213916023 wait complete. 2024-09-17T04:09:17.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.043+0000 7efc384de640 1 Processor -- start 2024-09-17T04:09:17.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.043+0000 7efc384de640 1 -- start start 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc301f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 0x7efc3015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efc3015fcf0 con 0x7efc3015bfc0 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efc3015fb70 con 0x7efc3006def0 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc384de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efc3015fe70 con 0x7efc300b5260 2024-09-17T04:09:17.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.044+0000 7efc3627a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52510/0 (socket says 172.21.15.192:52510) 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc35a79640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc301f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 -- 172.21.15.192:0/1573278705 learned_addr learned my addr 172.21.15.192:0/1573278705 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc36a7b640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 0x7efc3015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 -- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 msgr2=0x7efc301f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc301f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 -- 172.21.15.192:0/1573278705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 msgr2=0x7efc3015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 0x7efc3015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 -- 172.21.15.192:0/1573278705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc301f9cb0 con 0x7efc3006def0 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc36a7b640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 0x7efc3015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc35a79640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc301f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc3627a640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efc2000e940 tx=0x7efc2000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:17.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2000cd80 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc20010430 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc301f5c50 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20010880 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc301f5940 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc20010a20 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.045+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7efc20004980 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.046+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3015ba80 con 0x7efc3006def0 2024-09-17T04:09:17.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.048+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efc20026070 con 0x7efc3006def0 2024-09-17T04:09:17.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.119+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae881500-83ef-4908-9d85-0d96fc0637e9", "id": 0} v 0) -- 0x7efc300747a0 con 0x7efc3006def0 2024-09-17T04:09:17.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.124+0000 7efc26ffd640 1 -- 172.21.15.192:0/1573278705 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae881500-83ef-4908-9d85-0d96fc0637e9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7efc20009490 con 0x7efc3006def0 2024-09-17T04:09:17.124 INFO:teuthology.orchestra.run.smithi192.stdout:0 2024-09-17T04:09:17.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 msgr2=0x7efc30155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efc2000e940 tx=0x7efc2000ee00 comp rx=0 tx=0).stop 2024-09-17T04:09:17.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 shutdown_connections 2024-09-17T04:09:17.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc3015bfc0 0x7efc3015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc300b5260 0x7efc301f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 --2- 172.21.15.192:0/1573278705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc3006def0 0x7efc30155220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 >> 172.21.15.192:0/1573278705 conn(0x7efc300cdca0 msgr2=0x7efc300ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 shutdown_connections 2024-09-17T04:09:17.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.125+0000 7efc384de640 1 -- 172.21.15.192:0/1573278705 wait complete. 2024-09-17T04:09:17.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2 1 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 -- 172.21.15.192:0/625791032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c806def0 msgr2=0x7f20c806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/625791032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c806def0 0x7f20c806f410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f20c806e6e0 tx=0x7f20b802a480 comp rx=0 tx=0).stop 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 -- 172.21.15.192:0/625791032 shutdown_connections 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/625791032 >> v2:172.21.15.104:3300/0 conn(0x7f20c815bfc0 0x7f20c815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/625791032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c80b5260 0x7f20c815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/625791032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c806def0 0x7f20c806f410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 -- 172.21.15.192:0/625791032 >> 172.21.15.192:0/625791032 conn(0x7f20c80cdca0 msgr2=0x7f20c80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 -- 172.21.15.192:0/625791032 shutdown_connections 2024-09-17T04:09:17.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.249+0000 7f20cd7c3640 1 -- 172.21.15.192:0/625791032 wait complete. 2024-09-17T04:09:17.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.251+0000 7f20cd7c3640 1 Processor -- start 2024-09-17T04:09:17.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.251+0000 7f20cd7c3640 1 -- start start 2024-09-17T04:09:17.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c80b5260 0x7f20c80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c815bfc0 0x7f20c81f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20c815fcf0 con 0x7f20c80b5260 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20c815fb70 con 0x7f20c815bfc0 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f20c815fe70 con 0x7f20c806def0 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54786/0 (socket says 172.21.15.192:54786) 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 -- 172.21.15.192:0/3972655148 learned_addr learned my addr 172.21.15.192:0/3972655148 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c77fe640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c815bfc0 0x7f20c81f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c67fc640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c80b5260 0x7f20c80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 -- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c815bfc0 msgr2=0x7f20c81f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c815bfc0 0x7f20c81f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 -- 172.21.15.192:0/3972655148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c80b5260 msgr2=0x7f20c80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c80b5260 0x7f20c80b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 -- 172.21.15.192:0/3972655148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c81efaa0 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20c6ffd640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009780 tx=0x7f20b8033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8031d60 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20b8033e10 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8005260 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.253+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c80b2a60 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.254+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c80b3020 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.254+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20b80047a0 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.254+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f20b80035f0 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.254+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c815ba80 con 0x7f20c806def0 2024-09-17T04:09:17.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.256+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f20b803f030 con 0x7f20c806def0 2024-09-17T04:09:17.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.328+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2", "id": 1} v 0) -- 0x7f20c80d1e10 con 0x7f20c806def0 2024-09-17T04:09:17.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20af7fe640 1 -- 172.21.15.192:0/3972655148 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f20b8004c70 con 0x7f20c806def0 2024-09-17T04:09:17.333 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 msgr2=0x7f20c81ef560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009780 tx=0x7f20b8033c20 comp rx=0 tx=0).stop 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 shutdown_connections 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c815bfc0 0x7f20c81f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c80b5260 0x7f20c80b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.333+0000 7f20cd7c3640 1 --2- 172.21.15.192:0/3972655148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c806def0 0x7f20c81ef560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.334+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 >> 172.21.15.192:0/3972655148 conn(0x7f20c80cdca0 msgr2=0x7f20c80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.334+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 shutdown_connections 2024-09-17T04:09:17.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.334+0000 7f20cd7c3640 1 -- 172.21.15.192:0/3972655148 wait complete. 2024-09-17T04:09:17.344 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 5a33277c-6209-45c3-8e11-c60735f21e3b 2 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 -- 172.21.15.192:0/2452284582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 msgr2=0x7f16a006f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 --2- 172.21.15.192:0/2452284582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a006f410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1690009830 tx=0x7f169002a5c0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 -- 172.21.15.192:0/2452284582 shutdown_connections 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 --2- 172.21.15.192:0/2452284582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a006f410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 -- 172.21.15.192:0/2452284582 >> 172.21.15.192:0/2452284582 conn(0x7f16a00cdca0 msgr2=0x7f16a00ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 -- 172.21.15.192:0/2452284582 shutdown_connections 2024-09-17T04:09:17.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.458+0000 7f16a4f89640 1 -- 172.21.15.192:0/2452284582 wait complete. 2024-09-17T04:09:17.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.460+0000 7f16a4f89640 1 Processor -- start 2024-09-17T04:09:17.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.460+0000 7f16a4f89640 1 -- start start 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 0x7f16a01f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a00b5670 0x7f16a01f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0071480 con 0x7f16a00b5670 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0071300 con 0x7f16a006def0 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f16a4f89640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16a0071600 con 0x7f16a00b5260 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f169e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f169dd9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 0x7f16a01f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f169e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52550/0 (socket says 172.21.15.192:52550) 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f169e59c640 1 -- 172.21.15.192:0/396880194 learned_addr learned my addr 172.21.15.192:0/396880194 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.461+0000 7f169ed9d640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a00b5670 0x7f16a01f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 -- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 msgr2=0x7f16a009dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 -- 172.21.15.192:0/396880194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a00b5670 msgr2=0x7f16a01f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a00b5670 0x7f16a01f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 -- 172.21.15.192:0/396880194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a01f2850 con 0x7f16a00b5260 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169e59c640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f169dd9b640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 0x7f16a01f5e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f168800c3c0 tx=0x7f168800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688017070 con 0x7f16a00b5260 2024-09-17T04:09:17.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16880035f0 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688003a40 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a01f2b30 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a00cd600 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f168801a070 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.462+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f168801ccb0 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.463+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a01f25d0 con 0x7f16a00b5260 2024-09-17T04:09:17.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.465+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f16a01f25d0 con 0x7f16a00b5260 2024-09-17T04:09:17.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.537+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a33277c-6209-45c3-8e11-c60735f21e3b", "id": 2} v 0) -- 0x7f16a0071ad0 con 0x7f16a00b5260 2024-09-17T04:09:17.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.540+0000 7f1696ffd640 1 -- 172.21.15.192:0/396880194 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a33277c-6209-45c3-8e11-c60735f21e3b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1688021030 con 0x7f16a00b5260 2024-09-17T04:09:17.540 INFO:teuthology.orchestra.run.smithi192.stdout:2 2024-09-17T04:09:17.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 msgr2=0x7f16a01f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 0x7f16a01f5e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f168800c3c0 tx=0x7f168800c880 comp rx=0 tx=0).stop 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 shutdown_connections 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a00b5670 0x7f16a01f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a00b5260 0x7f16a01f5e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 --2- 172.21.15.192:0/396880194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a006def0 0x7f16a009dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 >> 172.21.15.192:0/396880194 conn(0x7f16a00cdca0 msgr2=0x7f16a015dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 shutdown_connections 2024-09-17T04:09:17.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.541+0000 7f16a4f89640 1 -- 172.21.15.192:0/396880194 wait complete. 2024-09-17T04:09:17.552 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 3a478367-3db8-46da-9cd0-157d6338787c 3 2024-09-17T04:09:17.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1294069233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 msgr2=0x7f89fc0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1294069233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc0d0670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0cc9c0 tx=0x7f89e802a4a0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1294069233 shutdown_connections 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1294069233 >> v2:172.21.15.104:3300/0 conn(0x7f89fc0d0bb0 0x7f89fc0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1294069233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc0d0670 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1294069233 >> 172.21.15.192:0/1294069233 conn(0x7f89fc0b46e0 msgr2=0x7f89fc0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1294069233 shutdown_connections 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.666+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1294069233 wait complete. 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.668+0000 7f8a02a9b640 1 Processor -- start 2024-09-17T04:09:17.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.668+0000 7f8a02a9b640 1 -- start start 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89fc0ccc40 0x7f89fc0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc0b6620 con 0x7f89fc0ccc40 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc0b64a0 con 0x7f89fc15ca90 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a02a9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc0b67a0 con 0x7f89fc0d0bb0 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a01038640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f89fbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a01038640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52570/0 (socket says 172.21.15.192:52570) 2024-09-17T04:09:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f89fbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54798/0 (socket says 172.21.15.192:54798) 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a01038640 1 -- 172.21.15.192:0/1023981533 learned_addr learned my addr 172.21.15.192:0/1023981533 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.669+0000 7f8a00837640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89fc0ccc40 0x7f89fc0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 -- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 msgr2=0x7f89fc0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 -- 172.21.15.192:0/1023981533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89fc0ccc40 msgr2=0x7f89fc0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89fc0ccc40 0x7f89fc0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 -- 172.21.15.192:0/1023981533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc0ca6f0 con 0x7f89fc15ca90 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89fbfff640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a01038640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89f400e990 tx=0x7f89f400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4004d20 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89f400caa0 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc0ca9d0 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4005020 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc0caf90 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89f40051c0 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.670+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f89f401a400 con 0x7f89fc15ca90 2024-09-17T04:09:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.671+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc0b6d30 con 0x7f89fc15ca90 2024-09-17T04:09:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.673+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f89f4016030 con 0x7f89fc15ca90 2024-09-17T04:09:17.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.744+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a478367-3db8-46da-9cd0-157d6338787c", "id": 3} v 0) -- 0x7f89fc0c8be0 con 0x7f89fc15ca90 2024-09-17T04:09:17.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.748+0000 7f89f97fa640 1 -- 172.21.15.192:0/1023981533 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a478367-3db8-46da-9cd0-157d6338787c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f89f4011540 con 0x7f89fc15ca90 2024-09-17T04:09:17.748 INFO:teuthology.orchestra.run.smithi192.stdout:3 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.749+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 msgr2=0x7f89fc1f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.749+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89f400e990 tx=0x7f89f400ee50 comp rx=0 tx=0).stop 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 shutdown_connections 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89fc15ca90 0x7f89fc1f37a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89fc0d0bb0 0x7f89fc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 --2- 172.21.15.192:0/1023981533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f89fc0ccc40 0x7f89fc0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 >> 172.21.15.192:0/1023981533 conn(0x7f89fc0b46e0 msgr2=0x7f89fc0b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 shutdown_connections 2024-09-17T04:09:17.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.750+0000 7f8a02a9b640 1 -- 172.21.15.192:0/1023981533 wait complete. 2024-09-17T04:09:17.760 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 196ed537-63cd-4e22-859b-ca5235f09c3f 4 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 -- 172.21.15.192:0/2208924367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec06def0 msgr2=0x7f47ec06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 --2- 172.21.15.192:0/2208924367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec06def0 0x7f47ec06f410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47ec073190 tx=0x7f47e802a530 comp rx=0 tx=0).stop 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 -- 172.21.15.192:0/2208924367 shutdown_connections 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 --2- 172.21.15.192:0/2208924367 >> v2:172.21.15.104:3300/0 conn(0x7f47ec0b5260 0x7f47ec15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 --2- 172.21.15.192:0/2208924367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec06def0 0x7f47ec06f410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 -- 172.21.15.192:0/2208924367 >> 172.21.15.192:0/2208924367 conn(0x7f47ec0cdca0 msgr2=0x7f47ec0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 -- 172.21.15.192:0/2208924367 shutdown_connections 2024-09-17T04:09:17.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.872+0000 7f47f330b640 1 -- 172.21.15.192:0/2208924367 wait complete. 2024-09-17T04:09:17.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.874+0000 7f47f330b640 1 Processor -- start 2024-09-17T04:09:17.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.874+0000 7f47f330b640 1 -- start start 2024-09-17T04:09:17.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47ec0b5260 0x7f47ec09c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec0b5a00 con 0x7f47ec0b5260 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec0b5880 con 0x7f47ec15bfc0 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.875+0000 7f47f330b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec071300 con 0x7f47ec06def0 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f10a7640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52574/0 (socket says 172.21.15.192:52574) 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f10a7640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54810/0 (socket says 172.21.15.192:54810) 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 -- 172.21.15.192:0/3120337368 learned_addr learned my addr 172.21.15.192:0/3120337368 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:17.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f08a6640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47ec0b5260 0x7f47ec09c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 -- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 msgr2=0x7f47ec15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 -- 172.21.15.192:0/3120337368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47ec0b5260 msgr2=0x7f47ec09c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47ec0b5260 0x7f47ec09c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 -- 172.21.15.192:0/3120337368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec0cc220 con 0x7f47ec15bfc0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f10a7640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f18a8640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47e400ca80 tx=0x7f47e400cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4016020 con 0x7f47ec15bfc0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e400ad20 con 0x7f47ec15bfc0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec09c7c0 con 0x7f47ec15bfc0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.876+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4012680 con 0x7f47ec15bfc0 2024-09-17T04:09:17.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.877+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec0cc7e0 con 0x7f47ec15bfc0 2024-09-17T04:09:17.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.877+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47e4019020 con 0x7f47ec15bfc0 2024-09-17T04:09:17.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.877+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f47e401bcc0 con 0x7f47ec15bfc0 2024-09-17T04:09:17.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.878+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec06f410 con 0x7f47ec15bfc0 2024-09-17T04:09:17.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.881+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f47e4020020 con 0x7f47ec15bfc0 2024-09-17T04:09:17.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.953+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "196ed537-63cd-4e22-859b-ca5235f09c3f", "id": 4} v 0) -- 0x7f47ec15d9f0 con 0x7f47ec15bfc0 2024-09-17T04:09:17.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.959+0000 7f47e1ffb640 1 -- 172.21.15.192:0/3120337368 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "196ed537-63cd-4e22-859b-ca5235f09c3f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f47e401b400 con 0x7f47ec15bfc0 2024-09-17T04:09:17.959 INFO:teuthology.orchestra.run.smithi192.stdout:4 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 msgr2=0x7f47ec09b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f47e400ca80 tx=0x7f47e400cf40 comp rx=0 tx=0).stop 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 shutdown_connections 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47ec15bfc0 0x7f47ec09b8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47ec0b5260 0x7f47ec09c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 --2- 172.21.15.192:0/3120337368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47ec06def0 0x7f47ec15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 >> 172.21.15.192:0/3120337368 conn(0x7f47ec0cdca0 msgr2=0x7f47ec0b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 shutdown_connections 2024-09-17T04:09:17.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:17.960+0000 7f47f330b640 1 -- 172.21.15.192:0/3120337368 wait complete. 2024-09-17T04:09:17.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 0704036c-3630-428b-bdd4-4cd2c6c40451 5 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/3065164373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c8806ddf0 msgr2=0x7f7c8806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/3065164373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c8806ddf0 0x7f7c8806e200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c78005fd0 tx=0x7f7c7802a540 comp rx=0 tx=0).stop 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/3065164373 shutdown_connections 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/3065164373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c8806ddf0 0x7f7c8806e200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/3065164373 >> v2:172.21.15.104:3300/0 conn(0x7f7c880b6290 0x7f7c880b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/3065164373 >> 172.21.15.192:0/3065164373 conn(0x7f7c880735d0 msgr2=0x7f7c880739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/3065164373 shutdown_connections 2024-09-17T04:09:18.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.084+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/3065164373 wait complete. 2024-09-17T04:09:18.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.086+0000 7f7c8fcc5640 1 Processor -- start 2024-09-17T04:09:18.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.086+0000 7f7c8fcc5640 1 -- start start 2024-09-17T04:09:18.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.087+0000 7f7c8fcc5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8806ddf0 0x7f7c881f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c8815b730 0x7f7c881576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7c88071820 con 0x7f7c8815b730 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c880716a0 con 0x7f7c8806ddf0 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7c880719a0 con 0x7f7c880b6290 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54832/0 (socket says 172.21.15.192:54832) 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 -- 172.21.15.192:0/708118693 learned_addr learned my addr 172.21.15.192:0/708118693 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8da61640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8806ddf0 0x7f7c881f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8e262640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c8815b730 0x7f7c881576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 -- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8806ddf0 msgr2=0x7f7c881f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8806ddf0 0x7f7c881f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 -- 172.21.15.192:0/708118693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c8815b730 msgr2=0x7f7c881576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c8815b730 0x7f7c881576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 -- 172.21.15.192:0/708118693 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c881f6030 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8d260640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00e7f0 tx=0x7f7c7c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00eea0 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c7c00cdb0 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c010690 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c881f6310 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.088+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c88157c30 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.089+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c7c010830 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.089+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7c7c018ba0 con 0x7f7c880b6290 2024-09-17T04:09:18.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.090+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c881f5da0 con 0x7f7c880b6290 2024-09-17T04:09:18.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.092+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c7c010c60 con 0x7f7c880b6290 2024-09-17T04:09:18.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.162+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0704036c-3630-428b-bdd4-4cd2c6c40451", "id": 5} v 0) -- 0x7f7c880d03c0 con 0x7f7c880b6290 2024-09-17T04:09:18.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.167+0000 7f7c867fc640 1 -- 172.21.15.192:0/708118693 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0704036c-3630-428b-bdd4-4cd2c6c40451", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7c880d03c0 con 0x7f7c880b6290 2024-09-17T04:09:18.167 INFO:teuthology.orchestra.run.smithi192.stdout:5 2024-09-17T04:09:18.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 msgr2=0x7f7c8815e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00e7f0 tx=0x7f7c7c00ecb0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 shutdown_connections 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c8815b730 0x7f7c881576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c880b6290 0x7f7c8815e800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 --2- 172.21.15.192:0/708118693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8806ddf0 0x7f7c881f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 >> 172.21.15.192:0/708118693 conn(0x7f7c880735d0 msgr2=0x7f7c880b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 shutdown_connections 2024-09-17T04:09:18.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.168+0000 7f7c8fcc5640 1 -- 172.21.15.192:0/708118693 wait complete. 2024-09-17T04:09:18.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 6e913243-9de1-451d-a6ce-16ad717f9b5a 6 2024-09-17T04:09:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 -- 172.21.15.192:0/1865509281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f40b5260 msgr2=0x7f60f415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 --2- 172.21.15.192:0/1865509281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f40b5260 0x7f60f415ba80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009860 tx=0x7f60e002a5a0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 -- 172.21.15.192:0/1865509281 shutdown_connections 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 --2- 172.21.15.192:0/1865509281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f40b5260 0x7f60f415ba80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 -- 172.21.15.192:0/1865509281 >> 172.21.15.192:0/1865509281 conn(0x7f60f40cdca0 msgr2=0x7f60f40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 -- 172.21.15.192:0/1865509281 shutdown_connections 2024-09-17T04:09:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.292+0000 7f60fadad640 1 -- 172.21.15.192:0/1865509281 wait complete. 2024-09-17T04:09:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.295+0000 7f60fadad640 1 Processor -- start 2024-09-17T04:09:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.295+0000 7f60fadad640 1 -- start start 2024-09-17T04:09:18.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60f415bfc0 0x7f60f4156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f60f4071300 con 0x7f60f415bfc0 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60f4071480 con 0x7f60f40b5260 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60fadad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f60f4071600 con 0x7f60f406def0 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f8b49640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f8b49640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54842/0 (socket says 172.21.15.192:54842) 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52580/0 (socket says 172.21.15.192:52580) 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f8b49640 1 -- 172.21.15.192:0/2182211116 learned_addr learned my addr 172.21.15.192:0/2182211116 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f934a640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60f415bfc0 0x7f60f4156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 -- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 msgr2=0x7f60f4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 -- 172.21.15.192:0/2182211116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60f415bfc0 msgr2=0x7f60f4156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60f415bfc0 0x7f60f4156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 -- 172.21.15.192:0/2182211116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f40b1b90 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f8b49640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f3fff640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60e0031000 tx=0x7f60e0033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0031b50 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.298+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60e0031e00 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f40b18b0 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005280 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f40b23d0 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60e00047a0 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f60e0003be0 con 0x7f60f40b5260 2024-09-17T04:09:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.299+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f4071ab0 con 0x7f60f40b5260 2024-09-17T04:09:18.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.302+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f60e003f030 con 0x7f60f40b5260 2024-09-17T04:09:18.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.373+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e913243-9de1-451d-a6ce-16ad717f9b5a", "id": 6} v 0) -- 0x7f60f4068e30 con 0x7f60f40b5260 2024-09-17T04:09:18.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.377+0000 7f60f17fa640 1 -- 172.21.15.192:0/2182211116 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e913243-9de1-451d-a6ce-16ad717f9b5a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f60e0004c70 con 0x7f60f40b5260 2024-09-17T04:09:18.377 INFO:teuthology.orchestra.run.smithi192.stdout:6 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 msgr2=0x7f60f40b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60e0031000 tx=0x7f60e0033ba0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 shutdown_connections 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60f40b5260 0x7f60f40b0c30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60f415bfc0 0x7f60f4156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 --2- 172.21.15.192:0/2182211116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60f406def0 0x7f60f4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 >> 172.21.15.192:0/2182211116 conn(0x7f60f40cdca0 msgr2=0x7f60f415df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 shutdown_connections 2024-09-17T04:09:18.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.378+0000 7f60fadad640 1 -- 172.21.15.192:0/2182211116 wait complete. 2024-09-17T04:09:18.389 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 8e444d9d-c1fe-452a-847f-1370732b1bb6 7 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 -- 172.21.15.192:0/291920113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d806ddf0 msgr2=0x7f54d806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 --2- 172.21.15.192:0/291920113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d806ddf0 0x7f54d806e200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54d0005fd0 tx=0x7f54d002aa10 comp rx=0 tx=0).stop 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 -- 172.21.15.192:0/291920113 shutdown_connections 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 --2- 172.21.15.192:0/291920113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d806ddf0 0x7f54d806e200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 --2- 172.21.15.192:0/291920113 >> v2:172.21.15.104:3300/0 conn(0x7f54d80b6290 0x7f54d80b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.501+0000 7f54deb12640 1 -- 172.21.15.192:0/291920113 >> 172.21.15.192:0/291920113 conn(0x7f54d80735d0 msgr2=0x7f54d80739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.502+0000 7f54deb12640 1 -- 172.21.15.192:0/291920113 shutdown_connections 2024-09-17T04:09:18.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.502+0000 7f54deb12640 1 -- 172.21.15.192:0/291920113 wait complete. 2024-09-17T04:09:18.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.503+0000 7f54deb12640 1 Processor -- start 2024-09-17T04:09:18.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.503+0000 7f54deb12640 1 -- start start 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d806ddf0 0x7f54d80b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 0x7f54d80b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8071820 con 0x7f54d806ddf0 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80716a0 con 0x7f54d80b6290 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54deb12640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80719a0 con 0x7f54d815b730 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 0x7f54d80b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54848/0 (socket says 172.21.15.192:54848) 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 -- 172.21.15.192:0/1132507421 learned_addr learned my addr 172.21.15.192:0/1132507421 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54d7fff640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 0x7f54d80b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52588/0 (socket says 172.21.15.192:52588) 2024-09-17T04:09:18.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dc8ae640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d806ddf0 0x7f54d80b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 -- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 msgr2=0x7f54d80b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 0x7f54d80b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 -- 172.21.15.192:0/1132507421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d806ddf0 msgr2=0x7f54d80b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d806ddf0 0x7f54d80b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 -- 172.21.15.192:0/1132507421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d80a95f0 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.505+0000 7f54dd0af640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009d90 tx=0x7f54d0003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0033050 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54d0004450 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d80a98d0 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0038450 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d80a9e90 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f54d0036070 con 0x7f54d815b730 2024-09-17T04:09:18.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.506+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f54d004bb30 con 0x7f54d815b730 2024-09-17T04:09:18.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.507+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d814c320 con 0x7f54d815b730 2024-09-17T04:09:18.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.509+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f54d0062860 con 0x7f54d815b730 2024-09-17T04:09:18.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.578+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e444d9d-c1fe-452a-847f-1370732b1bb6", "id": 7} v 0) -- 0x7f54d8071ea0 con 0x7f54d815b730 2024-09-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.582+0000 7f54d57fa640 1 -- 172.21.15.192:0/1132507421 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e444d9d-c1fe-452a-847f-1370732b1bb6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f54d0050030 con 0x7f54d815b730 2024-09-17T04:09:18.582 INFO:teuthology.orchestra.run.smithi192.stdout:7 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 msgr2=0x7f54d8149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009d90 tx=0x7f54d0003f10 comp rx=0 tx=0).stop 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 shutdown_connections 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d80b6290 0x7f54d80b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54d815b730 0x7f54d8149530 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 --2- 172.21.15.192:0/1132507421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d806ddf0 0x7f54d80b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 >> 172.21.15.192:0/1132507421 conn(0x7f54d80735d0 msgr2=0x7f54d80cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 shutdown_connections 2024-09-17T04:09:18.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:09:18.583+0000 7f54deb12640 1 -- 172.21.15.192:0/1132507421 wait complete. 2024-09-17T04:09:18.594 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T04:09:18.594 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T04:09:18.596 INFO:tasks.ceph.osd.0:Started 2024-09-17T04:09:18.596 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T04:09:18.596 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T04:09:18.598 INFO:tasks.ceph.osd.1:Started 2024-09-17T04:09:18.598 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T04:09:18.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T04:09:18.600 INFO:tasks.ceph.osd.2:Started 2024-09-17T04:09:18.601 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T04:09:18.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T04:09:18.603 INFO:tasks.ceph.osd.3:Started 2024-09-17T04:09:18.603 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T04:09:18.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T04:09:18.605 INFO:tasks.ceph.osd.4:Started 2024-09-17T04:09:18.605 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T04:09:18.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T04:09:18.607 INFO:tasks.ceph.osd.5:Started 2024-09-17T04:09:18.607 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T04:09:18.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T04:09:18.609 INFO:tasks.ceph.osd.6:Started 2024-09-17T04:09:18.609 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T04:09:18.610 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T04:09:18.612 INFO:tasks.ceph.osd.7:Started 2024-09-17T04:09:18.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.753+0000 7f56f1da9640 1 -- 172.21.15.104:0/1594296896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 msgr2=0x7f56ec0cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.753+0000 7f56f1da9640 1 --2- 172.21.15.104:0/1594296896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec0cc930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009830 tx=0x7f56e002a510 comp rx=0 tx=0).stop 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 -- 172.21.15.104:0/1594296896 shutdown_connections 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 --2- 172.21.15.104:0/1594296896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 --2- 172.21.15.104:0/1594296896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec0cc930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 -- 172.21.15.104:0/1594296896 >> 172.21.15.104:0/1594296896 conn(0x7f56ec0cef40 msgr2=0x7f56ec0cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 -- 172.21.15.104:0/1594296896 shutdown_connections 2024-09-17T04:09:18.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.754+0000 7f56f1da9640 1 -- 172.21.15.104:0/1594296896 wait complete. 2024-09-17T04:09:18.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.755+0000 7f56f1da9640 1 Processor -- start 2024-09-17T04:09:18.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.756+0000 7f56f1da9640 1 -- start start 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 0x7f56ec1f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0d0d90 con 0x7f56ec0d1ed0 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec0d0c10 con 0x7f56ec1536e0 2024-09-17T04:09:18.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56f1da9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec0d0f10 con 0x7f56ec0cce70 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35768/0 (socket says 172.21.15.104:35768) 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eaffd640 1 -- 172.21.15.104:0/3097834399 learned_addr learned my addr 172.21.15.104:0/3097834399 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56ebfff640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 0x7f56ec1f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 -- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 msgr2=0x7f56ec1f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 0x7f56ec1f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 -- 172.21.15.104:0/3097834399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 msgr2=0x7f56ec14ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eb7fe640 1 -- 172.21.15.104:0/3097834399 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec0cc120 con 0x7f56ec0cce70 2024-09-17T04:09:18.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56ebfff640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 0x7f56ec1f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.757+0000 7f56eaffd640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56eb7fe640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0a9450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c3c0 tx=0x7f56dc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011790 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56dc017070 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec06f370 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011cc0 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec0ca5e0 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56dc01c460 con 0x7f56ec0cce70 2024-09-17T04:09:18.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.758+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f56dc012d70 con 0x7f56ec0cce70 2024-09-17T04:09:18.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.759+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec0d04c0 con 0x7f56ec0cce70 2024-09-17T04:09:18.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.761+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f56ec0cd280 con 0x7f56ec0cce70 2024-09-17T04:09:18.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.821+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56ec0b7e20 con 0x7f56ec0cce70 2024-09-17T04:09:18.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.822+0000 7f56d3fff640 1 -- 172.21.15.104:0/3097834399 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f56dc011e60 con 0x7f56ec0cce70 2024-09-17T04:09:18.822 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:18.822 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:18.580292+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:18.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 msgr2=0x7f56ec0a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:18.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0a9450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c3c0 tx=0x7f56dc00c880 comp rx=0 tx=0).stop 2024-09-17T04:09:18.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 shutdown_connections 2024-09-17T04:09:18.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56ec1536e0 0x7f56ec1f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56ec0d1ed0 0x7f56ec14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 --2- 172.21.15.104:0/3097834399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56ec0cce70 0x7f56ec0a9450 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 >> 172.21.15.104:0/3097834399 conn(0x7f56ec0cef40 msgr2=0x7f56ec152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 shutdown_connections 2024-09-17T04:09:18.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:18.823+0000 7f56f1da9640 1 -- 172.21.15.104:0/3097834399 wait complete. 2024-09-17T04:09:18.834 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T04:09:18.834 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T04:09:19.640 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:19.745 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 -- 172.21.15.104:0/2891162883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5788073ea0 msgr2=0x7f57880742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 --2- 172.21.15.104:0/2891162883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5788073ea0 0x7f57880742b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5780005fd0 tx=0x7f578002a8b0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 -- 172.21.15.104:0/2891162883 shutdown_connections 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 --2- 172.21.15.104:0/2891162883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5788073ea0 0x7f57880742b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 --2- 172.21.15.104:0/2891162883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 -- 172.21.15.104:0/2891162883 >> 172.21.15.104:0/2891162883 conn(0x7f57880d1140 msgr2=0x7f57880d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 -- 172.21.15.104:0/2891162883 shutdown_connections 2024-09-17T04:09:19.746 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.745+0000 7f578cfba640 1 -- 172.21.15.104:0/2891162883 wait complete. 2024-09-17T04:09:19.747 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.747+0000 7f578cfba640 1 Processor -- start 2024-09-17T04:09:19.747 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.747+0000 7f578cfba640 1 -- start start 2024-09-17T04:09:19.750 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 0x7f57881504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:19.750 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578809e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:19.750 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:19.750 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f578806ec20 con 0x7f578815ef60 2024-09-17T04:09:19.750 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f578806eaa0 con 0x7f5788073ea0 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578cfba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f578806eda0 con 0x7f57880cf1d0 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5786d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5786d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35786/0 (socket says 172.21.15.104:35786) 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5786d9d640 1 -- 172.21.15.104:0/1343833639 learned_addr learned my addr 172.21.15.104:0/1343833639 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578659c640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 0x7f57881504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578809e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 -- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 msgr2=0x7f57881504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 0x7f57881504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 -- 172.21.15.104:0/1343833639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 msgr2=0x7f578806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.751 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 -- 172.21.15.104:0/1343833639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57881f7000 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f578659c640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 0x7f57881504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5786d9d640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.749+0000 7f5785d9b640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578809e0d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f577000c390 tx=0x7f577000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770011790 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5770017070 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57881f72e0 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770011ce0 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881f78a0 con 0x7f57880cf1d0 2024-09-17T04:09:19.752 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.750+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f577001c460 con 0x7f57880cf1d0 2024-09-17T04:09:19.753 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.751+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f57700520b0 con 0x7f57880cf1d0 2024-09-17T04:09:19.753 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.751+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578815b2a0 con 0x7f57880cf1d0 2024-09-17T04:09:19.753 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.753+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f578815b2a0 con 0x7f57880cf1d0 2024-09-17T04:09:19.813 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.814+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f578806f330 con 0x7f57880cf1d0 2024-09-17T04:09:19.814 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.814+0000 7f577effd640 1 -- 172.21.15.104:0/1343833639 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f57880747f0 con 0x7f57880cf1d0 2024-09-17T04:09:19.814 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-17T04:09:19.814 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:18.580292+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:19.815 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 msgr2=0x7f578809e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:19.815 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578809e0d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f577000c390 tx=0x7f577000c850 comp rx=0 tx=0).stop 2024-09-17T04:09:19.815 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 shutdown_connections 2024-09-17T04:09:19.815 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f578815ef60 0x7f578806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.815 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57880cf1d0 0x7f578809e0d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.816 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 --2- 172.21.15.104:0/1343833639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5788073ea0 0x7f57881504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:19.816 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 >> 172.21.15.104:0/1343833639 conn(0x7f57880d1140 msgr2=0x7f57880b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:19.816 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 shutdown_connections 2024-09-17T04:09:19.816 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:19.815+0000 7f578cfba640 1 -- 172.21.15.104:0/1343833639 wait complete. 2024-09-17T04:09:19.824 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T04:09:19.866 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T04:09:19.866+0000 7f093b00c640 -1 Falling back to public interface 2024-09-17T04:09:20.112 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T04:09:20.112+0000 7fa2e1d25640 -1 Falling back to public interface 2024-09-17T04:09:20.113 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T04:09:20.112+0000 7f4642011640 -1 Falling back to public interface 2024-09-17T04:09:20.322 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T04:09:20.323+0000 7f4c10d45640 -1 Falling back to public interface 2024-09-17T04:09:20.329 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T04:09:20.329+0000 7fccbf21e640 -1 Falling back to public interface 2024-09-17T04:09:20.348 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-09-17T04:09:20.348+0000 7fa014a8f640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T04:09:20.348 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-09-17T04:09:20.348+0000 7fa014a8f640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T04:09:20.350 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T04:09:20.350+0000 7f9cfadcc640 -1 Falling back to public interface 2024-09-17T04:09:20.359 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T04:09:20.360+0000 7fe41a00b640 -1 Falling back to public interface 2024-09-17T04:09:20.554 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T04:09:20.553+0000 7f706b611640 -1 Falling back to public interface 2024-09-17T04:09:23.428 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T04:09:23.428+0000 7f093b00c640 -1 osd.1 0 log_to_monitors true 2024-09-17T04:09:23.625 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T04:09:23.625+0000 7fa2e1d25640 -1 osd.0 0 log_to_monitors true 2024-09-17T04:09:23.869 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T04:09:23.869+0000 7f4c10d45640 -1 osd.5 0 log_to_monitors true 2024-09-17T04:09:24.078 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T04:09:24.079+0000 7fccbf21e640 -1 osd.2 0 log_to_monitors true 2024-09-17T04:09:24.149 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T04:09:24.149+0000 7fe41a00b640 -1 osd.6 0 log_to_monitors true 2024-09-17T04:09:24.420 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T04:09:24.420+0000 7f4642011640 -1 osd.7 0 log_to_monitors true 2024-09-17T04:09:24.561 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T04:09:24.562+0000 7f706b611640 -1 osd.4 0 log_to_monitors true 2024-09-17T04:09:24.681 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T04:09:24.680+0000 7f9cfadcc640 -1 osd.3 0 log_to_monitors true 2024-09-17T04:09:25.329 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T04:09:25.329+0000 7f09370dd640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T04:09:25.343 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T04:09:25.344+0000 7f092e6be640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:26.631 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:26.772 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.772+0000 7fdcb02bd640 1 -- 172.21.15.104:0/3363014884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc94003a00 msgr2=0x7fdc94003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.772+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/3363014884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc94003a00 0x7fdc94003e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009b50 tx=0x7fdc94005830 comp rx=0 tx=0).stop 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.773+0000 7fdcae85a640 1 -- 172.21.15.104:0/3363014884 reap_dead start 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.773+0000 7fdcb02bd640 1 -- 172.21.15.104:0/3363014884 shutdown_connections 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.773+0000 7fdcb02bd640 1 -- 172.21.15.104:0/3363014884 >> 172.21.15.104:0/3363014884 conn(0x7fdca8073e30 msgr2=0x7fdca8074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.773+0000 7fdcb02bd640 1 -- 172.21.15.104:0/3363014884 shutdown_connections 2024-09-17T04:09:26.773 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.773+0000 7fdcb02bd640 1 -- 172.21.15.104:0/3363014884 wait complete. 2024-09-17T04:09:26.774 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.775+0000 7fdcb02bd640 1 Processor -- start 2024-09-17T04:09:26.774 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.775+0000 7fdcb02bd640 1 -- start start 2024-09-17T04:09:26.776 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 0x7fdca80c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 0x7fdca80adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca80ae320 0x7fdca80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdca815f560 con 0x7fdca814a6e0 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80b52e0 con 0x7fdca814a2d0 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcb02bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdca815f6e0 con 0x7fdca80ae320 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcae059640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 0x7fdca80c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcae059640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 0x7fdca80c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:60410/0 (socket says 172.21.15.104:60410) 2024-09-17T04:09:26.777 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcae059640 1 -- 172.21.15.104:0/1513323841 learned_addr learned my addr 172.21.15.104:0/1513323841 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.777+0000 7fdcad858640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 0x7fdca80adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcae85a640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca80ae320 0x7fdca80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcad858640 1 -- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca80ae320 msgr2=0x7fdca80c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcad858640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca80ae320 0x7fdca80c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcad858640 1 -- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 msgr2=0x7fdca80c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcad858640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 0x7fdca80c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:26.778 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.778+0000 7fdcad858640 1 -- 172.21.15.104:0/1513323841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca80ae730 con 0x7fdca814a6e0 2024-09-17T04:09:26.779 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdcad858640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 0x7fdca80adde0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc98011830 tx=0x7fdc98011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:26.779 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800f9a0 con 0x7fdca814a6e0 2024-09-17T04:09:26.779 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc9800fb40 con 0x7fdca814a6e0 2024-09-17T04:09:26.779 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca81f8c30 con 0x7fdca814a6e0 2024-09-17T04:09:26.780 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc980035f0 con 0x7fdca814a6e0 2024-09-17T04:09:26.780 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.779+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca81f94d0 con 0x7fdca814a6e0 2024-09-17T04:09:26.780 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.781+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca815b350 con 0x7fdca814a6e0 2024-09-17T04:09:26.782 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.782+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fdc98003790 con 0x7fdca814a6e0 2024-09-17T04:09:26.783 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.783+0000 7fdc9effd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 0x7fdc8c07b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:26.783 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.783+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7fdc9809af90 con 0x7fdca814a6e0 2024-09-17T04:09:26.783 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.783+0000 7fdcae059640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 0x7fdc8c07b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:26.783 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.784+0000 7fdcae059640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 0x7fdc8c07b040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009a70 tx=0x7fdca402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:26.789 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:26.790+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc980641b0 con 0x7fdca814a6e0 2024-09-17T04:09:26.893 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T04:09:26.893+0000 7fccbb472640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T04:09:26.902 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T04:09:26.902+0000 7fa2de4c8640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T04:09:26.911 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T04:09:26.911+0000 7fccb2a53640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:26.930 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T04:09:26.931+0000 7fa2d5aa9640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:27.061 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.061+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdca80b5850 con 0x7fdca814a6e0 2024-09-17T04:09:27.062 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.062+0000 7fdc9effd640 1 -- 172.21.15.104:0/1513323841 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7fdc98063ab0 con 0x7fdca814a6e0 2024-09-17T04:09:27.062 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-17T04:09:27.062 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":14,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:26.486879+0000","last_up_change":"2024-09-17T04:09:25.485296+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:27.064 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 msgr2=0x7fdc8c07b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:27.064 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 0x7fdc8c07b040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009a70 tx=0x7fdca402d040 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 msgr2=0x7fdca80adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 0x7fdca80adde0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc98011830 tx=0x7fdc98011c30 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 shutdown_connections 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdc8c078b30 0x7fdc8c07b040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdca80ae320 0x7fdca80c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdca814a6e0 0x7fdca80adde0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 --2- 172.21.15.104:0/1513323841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdca814a2d0 0x7fdca80c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 >> 172.21.15.104:0/1513323841 conn(0x7fdca8073e30 msgr2=0x7fdca8068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 shutdown_connections 2024-09-17T04:09:27.065 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:27.064+0000 7fdcb02bd640 1 -- 172.21.15.104:0/1513323841 wait complete. 2024-09-17T04:09:27.075 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T04:09:27.349 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T04:09:27.349+0000 7fe4161ed640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T04:09:27.372 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T04:09:27.373+0000 7fe40d7ce640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:27.421 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T04:09:27.421+0000 7f9cf6d5a640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T04:09:27.436 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T04:09:27.436+0000 7f9ceeb50640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:27.445 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T04:09:27.447+0000 7f463d991640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T04:09:27.458 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T04:09:27.460+0000 7f4635787640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:27.652 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T04:09:27.653+0000 7f4c0ccd3640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T04:09:27.670 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T04:09:27.671+0000 7f4c04ac9640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:27.686 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T04:09:27.688+0000 7f7067732640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T04:09:27.703 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T04:09:27.704+0000 7f705ed13640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:09:33.882 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:34.000 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 -- 172.21.15.104:0/2318387950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc48004d40 msgr2=0x7fcc48005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.000 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 --2- 172.21.15.104:0/2318387950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc48004d40 0x7fcc48005170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c560 tx=0x7fcc48005830 comp rx=0 tx=0).stop 2024-09-17T04:09:34.000 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc5ed9d640 1 -- 172.21.15.104:0/2318387950 reap_dead start 2024-09-17T04:09:34.000 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 -- 172.21.15.104:0/2318387950 shutdown_connections 2024-09-17T04:09:34.001 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 -- 172.21.15.104:0/2318387950 >> 172.21.15.104:0/2318387950 conn(0x7fcc600b2cc0 msgr2=0x7fcc600b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:34.001 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 -- 172.21.15.104:0/2318387950 shutdown_connections 2024-09-17T04:09:34.001 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.000+0000 7fcc64815640 1 -- 172.21.15.104:0/2318387950 wait complete. 2024-09-17T04:09:34.002 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.002+0000 7fcc64815640 1 Processor -- start 2024-09-17T04:09:34.002 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.002+0000 7fcc64815640 1 -- start start 2024-09-17T04:09:34.004 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc48004d40 0x7fcc601f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.004 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc600ae4a0 0x7fcc601f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6006ea80 con 0x7fcc600b23d0 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6006e900 con 0x7fcc48004d40 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.003+0000 7fcc64815640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6015b5d0 con 0x7fcc600ae4a0 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49028/0 (socket says 172.21.15.104:49028) 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 -- 172.21.15.104:0/1955093383 learned_addr learned my addr 172.21.15.104:0/1955093383 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5e59c640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc48004d40 0x7fcc601f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5ed9d640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc600ae4a0 0x7fcc601f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 -- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc600ae4a0 msgr2=0x7fcc601f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc600ae4a0 0x7fcc601f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.005 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 -- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc48004d40 msgr2=0x7fcc601f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc48004d40 0x7fcc601f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 -- 172.21.15.104:0/1955093383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc600c6140 con 0x7fcc600b23d0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc5dd9b640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc54003ef0 tx=0x7fcc54001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54015070 con 0x7fcc600b23d0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc54011900 con 0x7fcc600b23d0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc600c6420 con 0x7fcc600b23d0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54011d50 con 0x7fcc600b23d0 2024-09-17T04:09:34.006 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.004+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc600c69e0 con 0x7fcc600b23d0 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.006+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc601f8f10 con 0x7fcc600b23d0 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.006+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc54018070 con 0x7fcc600b23d0 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.006+0000 7fcc4effd640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 0x7fcc4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.006+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fcc5409b640 con 0x7fcc600b23d0 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.007+0000 7fcc5e59c640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 0x7fcc4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.007 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.007+0000 7fcc5e59c640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 0x7fcc4007b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009b90 tx=0x7fcc50005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:34.011 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.011+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc54063e60 con 0x7fcc600b23d0 2024-09-17T04:09:34.189 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.189+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc600b3fc0 con 0x7fcc600b23d0 2024-09-17T04:09:34.189 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.190+0000 7fcc4effd640 1 -- 172.21.15.104:0/1955093383 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7fcc54063760 con 0x7fcc600b23d0 2024-09-17T04:09:34.190 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-17T04:09:34.190 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":19,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:31.938027+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:34.192 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 msgr2=0x7fcc4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.192 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 0x7fcc4007b0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009b90 tx=0x7fcc50005f90 comp rx=0 tx=0).stop 2024-09-17T04:09:34.192 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 msgr2=0x7fcc600adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc54003ef0 tx=0x7fcc54001710 comp rx=0 tx=0).stop 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 shutdown_connections 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fcc40078bc0 0x7fcc4007b0d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc600ae4a0 0x7fcc601f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc600b23d0 0x7fcc600adf60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 --2- 172.21.15.104:0/1955093383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc48004d40 0x7fcc601f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 >> 172.21.15.104:0/1955093383 conn(0x7fcc600b2cc0 msgr2=0x7fcc600cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 shutdown_connections 2024-09-17T04:09:34.193 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T04:09:34.192+0000 7fcc64815640 1 -- 172.21.15.104:0/1955093383 wait complete. 2024-09-17T04:09:34.202 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T04:09:34.202 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T04:09:34.202 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T04:09:34.202 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T04:09:34.205 INFO:tasks.ceph.mds.a:Started 2024-09-17T04:09:34.205 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T04:09:34.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T04:09:34.207 INFO:tasks.ceph.mds.c:Started 2024-09-17T04:09:34.207 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T04:09:34.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T04:09:34.209 INFO:tasks.ceph.mds.b:Started 2024-09-17T04:09:34.209 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T04:09:34.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T04:09:34.212 INFO:tasks.ceph.mds.d:Started 2024-09-17T04:09:34.212 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T04:09:34.212 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:09:34.289 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T04:09:34.290 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T04:09:34.308 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T04:09:34.308 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T04:09:34.308 INFO:tasks.ceph.mds.d.smithi192.stderr:2024-09-17T04:09:34.309+0000 7fa284a5b640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T04:09:34.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 -- 172.21.15.104:0/2252591501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a006ddf0 msgr2=0x7fa4a006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 --2- 172.21.15.104:0/2252591501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a006ddf0 0x7fa4a006e200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa498005fd0 tx=0x7fa49802a840 comp rx=0 tx=0).stop 2024-09-17T04:09:34.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 -- 172.21.15.104:0/2252591501 shutdown_connections 2024-09-17T04:09:34.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 --2- 172.21.15.104:0/2252591501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a006ddf0 0x7fa4a006e200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 -- 172.21.15.104:0/2252591501 >> 172.21.15.104:0/2252591501 conn(0x7fa4a0073560 msgr2=0x7fa4a0073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:34.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 -- 172.21.15.104:0/2252591501 shutdown_connections 2024-09-17T04:09:34.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.331+0000 7fa4a7120640 1 -- 172.21.15.104:0/2252591501 wait complete. 2024-09-17T04:09:34.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.333+0000 7fa4a7120640 1 Processor -- start 2024-09-17T04:09:34.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.333+0000 7fa4a7120640 1 -- start start 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a00cc1f0 0x7fa4a01e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015ad20 0x7fa4a01e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0069c50 con 0x7fa4a015ad20 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0069ad0 con 0x7fa4a00cc1f0 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a7120640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a0069dd0 con 0x7fa4a006ddf0 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:44094/0 (socket says 172.21.15.104:44094) 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 -- 172.21.15.104:0/3382802079 learned_addr learned my addr 172.21.15.104:0/3382802079 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa49ffff640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a00cc1f0 0x7fa4a01e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a56bd640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015ad20 0x7fa4a01e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 -- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a00cc1f0 msgr2=0x7fa4a01e67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a00cc1f0 0x7fa4a01e67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 -- 172.21.15.104:0/3382802079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015ad20 msgr2=0x7fa4a01e6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015ad20 0x7fa4a01e6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.335+0000 7fa4a4ebc640 1 -- 172.21.15.104:0/3382802079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a01f20a0 con 0x7fa4a006ddf0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa4a4ebc640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa494001220 tx=0x7fa49400da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494014070 con 0x7fa4a006ddf0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa49400ca10 con 0x7fa4a006ddf0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49400b050 con 0x7fa4a006ddf0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a01f1520 con 0x7fa4a006ddf0 2024-09-17T04:09:34.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.336+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01f1ae0 con 0x7fa4a006ddf0 2024-09-17T04:09:34.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.337+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a00c6c20 con 0x7fa4a006ddf0 2024-09-17T04:09:34.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.338+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa494017070 con 0x7fa4a006ddf0 2024-09-17T04:09:34.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.338+0000 7fa49d7fa640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:34.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.338+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa49409aa50 con 0x7fa4a006ddf0 2024-09-17T04:09:34.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.339+0000 7fa49ffff640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:34.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.339+0000 7fa49ffff640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 0x7fa48407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa4a01f46d0 tx=0x7fa48c007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:34.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.343+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa494062b80 con 0x7fa4a006ddf0 2024-09-17T04:09:34.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:09:34.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:09:34.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.556+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4a0159e50 con 0x7fa4a006ddf0 2024-09-17T04:09:34.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.557+0000 7fa49d7fa640 1 -- 172.21.15.104:0/3382802079 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fa4940675b0 con 0x7fa4a006ddf0 2024-09-17T04:09:34.557 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:34.557 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":2,"btime":"2024-09-17T04:09:34:295983+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T04:09:34.557 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 2 2024-09-17T04:09:34.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 msgr2=0x7fa48407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 0x7fa48407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa4a01f46d0 tx=0x7fa48c007df0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 msgr2=0x7fa4a01583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa494001220 tx=0x7fa49400da20 comp rx=0 tx=0).stop 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 shutdown_connections 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a00cc1f0 0x7fa4a01e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015ad20 0x7fa4a01e6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 --2- 172.21.15.104:0/3382802079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a006ddf0 0x7fa4a01583e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 >> 172.21.15.104:0/3382802079 conn(0x7fa4a0073560 msgr2=0x7fa4a00b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 shutdown_connections 2024-09-17T04:09:34.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:34.559+0000 7fa4a7120640 1 -- 172.21.15.104:0/3382802079 wait complete. 2024-09-17T04:09:36.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:09:36.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 -- 172.21.15.104:0/1343020303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70800039e0 msgr2=0x7f7080003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:36.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 --2- 172.21.15.104:0/1343020303 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70800039e0 0x7f7080003e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7084001ec0 tx=0x7f7080005830 comp rx=0 tx=0).stop 2024-09-17T04:09:36.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f70995c4640 1 -- 172.21.15.104:0/1343020303 reap_dead start 2024-09-17T04:09:36.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 -- 172.21.15.104:0/1343020303 shutdown_connections 2024-09-17T04:09:36.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 -- 172.21.15.104:0/1343020303 >> 172.21.15.104:0/1343020303 conn(0x7f7094073560 msgr2=0x7f7094073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:36.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 -- 172.21.15.104:0/1343020303 shutdown_connections 2024-09-17T04:09:36.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.697+0000 7f709b027640 1 -- 172.21.15.104:0/1343020303 wait complete. 2024-09-17T04:09:36.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.699+0000 7f709b027640 1 Processor -- start 2024-09-17T04:09:36.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.699+0000 7f709b027640 1 -- start start 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800039e0 0x7f70940c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7094149950 0x7f70941467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f709415fd00 con 0x7f709414ca50 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f709415fb80 con 0x7f70800039e0 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f709b027640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f709415fe80 con 0x7f7094149950 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f70995c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f70995c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43278/0 (socket says 172.21.15.104:43278) 2024-09-17T04:09:36.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f70995c4640 1 -- 172.21.15.104:0/492104938 learned_addr learned my addr 172.21.15.104:0/492104938 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f7093fff640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7094149950 0x7f70941467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.700+0000 7f7098dc3640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800039e0 0x7f70940c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 -- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7094149950 msgr2=0x7f70941467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7094149950 0x7f70941467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 -- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800039e0 msgr2=0x7f70940c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800039e0 0x7f70940c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 -- 172.21.15.104:0/492104938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709414d230 con 0x7f709414ca50 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70995c4640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f709415cae0 tx=0x7f708c011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c00f920 con 0x7f709414ca50 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f708c00fae0 con 0x7f709414ca50 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c005020 con 0x7f709414ca50 2024-09-17T04:09:36.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70940b6110 con 0x7f709414ca50 2024-09-17T04:09:36.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.701+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70940b5de0 con 0x7f709414ca50 2024-09-17T04:09:36.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.702+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094149e10 con 0x7f709414ca50 2024-09-17T04:09:36.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.703+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f708c0051c0 con 0x7f709414ca50 2024-09-17T04:09:36.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.703+0000 7f70917fa640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 0x7f707407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:36.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.703+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f708c09b0a0 con 0x7f709414ca50 2024-09-17T04:09:36.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.703+0000 7f7098dc3640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 0x7f707407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:36.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.704+0000 7f7098dc3640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 0x7f707407b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7084033000 tx=0x7f708402d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:36.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.708+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f709414d230 con 0x7f709414ca50 2024-09-17T04:09:36.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.916+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f709415bfa0 con 0x7f709414ca50 2024-09-17T04:09:36.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.916+0000 7f70917fa640 1 -- 172.21.15.104:0/492104938 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f708c011e20 con 0x7f709414ca50 2024-09-17T04:09:36.916 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:36.917 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"btime":"2024-09-17T04:09:35:299076+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4425,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T04:09:36.917 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 3 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 msgr2=0x7f707407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 0x7f707407b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7084033000 tx=0x7f708402d000 comp rx=0 tx=0).stop 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 msgr2=0x7f70941f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f709415cae0 tx=0x7f708c011bd0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 shutdown_connections 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7074078bc0 0x7f707407b0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f709414ca50 0x7f70941f6c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7094149950 0x7f70941467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 --2- 172.21.15.104:0/492104938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800039e0 0x7f70940c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:36.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 >> 172.21.15.104:0/492104938 conn(0x7f7094073560 msgr2=0x7f70940b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:36.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 shutdown_connections 2024-09-17T04:09:36.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:36.919+0000 7f709b027640 1 -- 172.21.15.104:0/492104938 wait complete. 2024-09-17T04:09:36.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T04:09:37.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 -- 172.21.15.104:0/1009987812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc8162280 msgr2=0x7f6bc8162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1009987812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc8162280 0x7f6bc8162690 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009830 tx=0x7f6bbc02a530 comp rx=0 tx=0).stop 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 -- 172.21.15.104:0/1009987812 shutdown_connections 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1009987812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc8162280 0x7f6bc8162690 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 -- 172.21.15.104:0/1009987812 >> 172.21.15.104:0/1009987812 conn(0x7f6bc80b6b20 msgr2=0x7f6bc80d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 -- 172.21.15.104:0/1009987812 shutdown_connections 2024-09-17T04:09:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.042+0000 7f6bce27e640 1 -- 172.21.15.104:0/1009987812 wait complete. 2024-09-17T04:09:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.043+0000 7f6bce27e640 1 Processor -- start 2024-09-17T04:09:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.044+0000 7f6bce27e640 1 -- start start 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 0x7f6bc815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 0x7f6bc8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc815f850 con 0x7f6bc815b100 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc815f6d0 con 0x7f6bc8162280 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bce27e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc815f9d0 con 0x7f6bc80b2e40 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43284/0 (socket says 172.21.15.104:43284) 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 -- 172.21.15.104:0/1214798673 learned_addr learned my addr 172.21.15.104:0/1214798673 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:37.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bc77fe640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 0x7f6bc8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bc7fff640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 0x7f6bc815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 -- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 msgr2=0x7f6bc815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 0x7f6bc815c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 -- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 msgr2=0x7f6bc8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 0x7f6bc8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 -- 172.21.15.104:0/1214798673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc815ce10 con 0x7f6bc815b100 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bc77fe640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 0x7f6bc8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bc7fff640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 0x7f6bc815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bcc81b640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c700 tx=0x7f6bc000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.045+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003b70 con 0x7f6bc815b100 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.046+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc0003d10 con 0x7f6bc815b100 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.046+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc815b830 con 0x7f6bc815b100 2024-09-17T04:09:37.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.046+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000aab0 con 0x7f6bc815b100 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.046+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc815bdf0 con 0x7f6bc815b100 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.046+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc8162f00 con 0x7f6bc815b100 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.047+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6bc000ac50 con 0x7f6bc815b100 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.048+0000 7f6bc4ff9640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 0x7f6bb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.048+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6bc009a750 con 0x7f6bc815b100 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.048+0000 7f6bc7fff640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 0x7f6bb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.048+0000 7f6bc7fff640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 0x7f6bb407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000f60 tx=0x7f6bb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:37.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.052+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6bc0062f70 con 0x7f6bc815b100 2024-09-17T04:09:37.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.227+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6bc80b8220 con 0x7f6bc815b100 2024-09-17T04:09:37.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.228+0000 7f6bc4ff9640 1 -- 172.21.15.104:0/1214798673 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f6bc0062870 con 0x7f6bc815b100 2024-09-17T04:09:37.227 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T04:09:37.228 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T04:09:37.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 msgr2=0x7f6bb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 0x7f6bb407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000f60 tx=0x7f6bb8009040 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 msgr2=0x7f6bc80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c700 tx=0x7f6bc000cbc0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 shutdown_connections 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6bb4078b90 0x7f6bb407b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8162280 0x7f6bc8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6bc815b100 0x7f6bc80ce940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 --2- 172.21.15.104:0/1214798673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6bc80b2e40 0x7f6bc815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 >> 172.21.15.104:0/1214798673 conn(0x7f6bc80b6b20 msgr2=0x7f6bc8068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 shutdown_connections 2024-09-17T04:09:37.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.230+0000 7f6bce27e640 1 -- 172.21.15.104:0/1214798673 wait complete. 2024-09-17T04:09:37.240 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T04:09:37.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T04:09:37.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 -- 172.21.15.104:0/1220585420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c15e7d0 msgr2=0x7f0a1c0b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1220585420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c15e7d0 0x7f0a1c0b5f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c08cf10 tx=0x7f0a0c02a560 comp rx=0 tx=0).stop 2024-09-17T04:09:37.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 -- 172.21.15.104:0/1220585420 shutdown_connections 2024-09-17T04:09:37.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1220585420 >> v2:172.21.15.192:3300/0 conn(0x7f0a1c0b64a0 0x7f0a1c1626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1220585420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c15e7d0 0x7f0a1c0b5f60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 -- 172.21.15.104:0/1220585420 >> 172.21.15.104:0/1220585420 conn(0x7f0a1c0d44e0 msgr2=0x7f0a1c0d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:37.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 -- 172.21.15.104:0/1220585420 shutdown_connections 2024-09-17T04:09:37.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.357+0000 7f0a2252b640 1 -- 172.21.15.104:0/1220585420 wait complete. 2024-09-17T04:09:37.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.359+0000 7f0a2252b640 1 Processor -- start 2024-09-17T04:09:37.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.359+0000 7f0a2252b640 1 -- start start 2024-09-17T04:09:37.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a1c0b64a0 0x7f0a1c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a1c15e7d0 0x7f0a1c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c1631a0 con 0x7f0a1c162c10 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c163020 con 0x7f0a1c0b64a0 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.360+0000 7f0a2252b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c06ea10 con 0x7f0a1c15e7d0 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43316/0 (socket says 172.21.15.104:43316) 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 -- 172.21.15.104:0/1600330701 learned_addr learned my addr 172.21.15.104:0/1600330701 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a1bfff640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a1c0b64a0 0x7f0a1c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a1b7fe640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a1c15e7d0 0x7f0a1c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 -- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a1c15e7d0 msgr2=0x7f0a1c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a1c15e7d0 0x7f0a1c0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 -- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a1c0b64a0 msgr2=0x7f0a1c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a1c0b64a0 0x7f0a1c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 -- 172.21.15.104:0/1600330701 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c0ccb20 con 0x7f0a1c162c10 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a20ac8640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a14002230 tx=0x7f0a1400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14003b70 con 0x7f0a1c162c10 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a14003d10 con 0x7f0a1c162c10 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c0aaf00 con 0x7f0a1c162c10 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14005330 con 0x7f0a1c162c10 2024-09-17T04:09:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.361+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c0ab4c0 con 0x7f0a1c162c10 2024-09-17T04:09:37.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.362+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c06ef30 con 0x7f0a1c162c10 2024-09-17T04:09:37.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.363+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a140056e0 con 0x7f0a1c162c10 2024-09-17T04:09:37.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.363+0000 7f0a18ff9640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 0x7f0a0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:37.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.363+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0a1409a8c0 con 0x7f0a1c162c10 2024-09-17T04:09:37.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.364+0000 7f0a1bfff640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 0x7f0a0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:37.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.364+0000 7f0a1bfff640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 0x7f0a0807b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c033000 tx=0x7f0a0c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:37.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.368+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a1c0b68b0 con 0x7f0a1c162c10 2024-09-17T04:09:37.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:37.542+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0a1c0ba2e0 con 0x7f0a1c162c10 2024-09-17T04:09:38.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.315+0000 7f0a18ff9640 1 -- 172.21.15.104:0/1600330701 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f0a14062a00 con 0x7f0a1c162c10 2024-09-17T04:09:38.315 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 msgr2=0x7f0a0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 0x7f0a0807b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c033000 tx=0x7f0a0c004730 comp rx=0 tx=0).stop 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 msgr2=0x7f0a1c1f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a14002230 tx=0x7f0a1400cb90 comp rx=0 tx=0).stop 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 shutdown_connections 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0a08078bc0 0x7f0a0807b0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a1c162c10 0x7f0a1c1f5e50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a1c15e7d0 0x7f0a1c0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 --2- 172.21.15.104:0/1600330701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a1c0b64a0 0x7f0a1c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 >> 172.21.15.104:0/1600330701 conn(0x7f0a1c0d44e0 msgr2=0x7f0a1c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:38.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 shutdown_connections 2024-09-17T04:09:38.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.318+0000 7f0a2252b640 1 -- 172.21.15.104:0/1600330701 wait complete. 2024-09-17T04:09:38.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-17T04:09:38.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 -- 172.21.15.104:0/2751041320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8318073d50 msgr2=0x7f8318074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:38.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 --2- 172.21.15.104:0/2751041320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8318073d50 0x7f8318074160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83180cd2c0 tx=0x7f831002a530 comp rx=0 tx=0).stop 2024-09-17T04:09:38.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 -- 172.21.15.104:0/2751041320 shutdown_connections 2024-09-17T04:09:38.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 --2- 172.21.15.104:0/2751041320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8318073d50 0x7f8318074160 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 --2- 172.21.15.104:0/2751041320 >> v2:172.21.15.192:3300/0 conn(0x7f83180b3fc0 0x7f83180b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 -- 172.21.15.104:0/2751041320 >> 172.21.15.104:0/2751041320 conn(0x7f83180b2cc0 msgr2=0x7f83180b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:38.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 -- 172.21.15.104:0/2751041320 shutdown_connections 2024-09-17T04:09:38.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.458+0000 7f831f120640 1 -- 172.21.15.104:0/2751041320 wait complete. 2024-09-17T04:09:38.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.460+0000 7f831f120640 1 Processor -- start 2024-09-17T04:09:38.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.460+0000 7f831f120640 1 -- start start 2024-09-17T04:09:38.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8318073d50 0x7f83180cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:38.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:38.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83180d0b40 0x7f831813f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:38.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f831815b750 con 0x7f83180b3fc0 2024-09-17T04:09:38.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f831815b5d0 con 0x7f83180d0b40 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.461+0000 7f831f120640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f831815b8d0 con 0x7f8318073d50 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43326/0 (socket says 172.21.15.104:43326) 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 -- 172.21.15.104:0/3726861296 learned_addr learned my addr 172.21.15.104:0/3726861296 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f831cebc640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8318073d50 0x7f83180cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f831d6bd640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83180d0b40 0x7f831813f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 -- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8318073d50 msgr2=0x7f83180cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8318073d50 0x7f83180cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 -- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83180d0b40 msgr2=0x7f831813f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83180d0b40 0x7f831813f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 -- 172.21.15.104:0/3726861296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83181f2d50 con 0x7f83180b3fc0 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f8317fff640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f830c00ea50 tx=0x7f830c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:38.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c00cdc0 con 0x7f83180b3fc0 2024-09-17T04:09:38.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f830c011560 con 0x7f83180b3fc0 2024-09-17T04:09:38.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181f7120 con 0x7f83180b3fc0 2024-09-17T04:09:38.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c011990 con 0x7f83180b3fc0 2024-09-17T04:09:38.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.462+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181f32f0 con 0x7f83180b3fc0 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.463+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831815bda0 con 0x7f83180b3fc0 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.464+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f830c01a400 con 0x7f83180b3fc0 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.465+0000 7f83157fa640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 0x7f830407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.465+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f830c09b640 con 0x7f83180b3fc0 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.465+0000 7f831cebc640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 0x7f830407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:38.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.465+0000 7f831cebc640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 0x7f830407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8308001720 tx=0x7f8308007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:38.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.469+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f830c016030 con 0x7f83180b3fc0 2024-09-17T04:09:38.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:38.646+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f83180696c0 con 0x7f83180b3fc0 2024-09-17T04:09:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.317+0000 7f83157fa640 1 -- 172.21.15.104:0/3726861296 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f830c063610 con 0x7f83180b3fc0 2024-09-17T04:09:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T04:09:39.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.320+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 msgr2=0x7f830407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:39.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.320+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 0x7f830407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8308001720 tx=0x7f8308007e90 comp rx=0 tx=0).stop 2024-09-17T04:09:39.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.320+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 msgr2=0x7f83181f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.320+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f830c00ea50 tx=0x7f830c00ef10 comp rx=0 tx=0).stop 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 shutdown_connections 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8304078b90 0x7f830407b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83180d0b40 0x7f831813f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83180b3fc0 0x7f83181f63b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 --2- 172.21.15.104:0/3726861296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8318073d50 0x7f83180cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 >> 172.21.15.104:0/3726861296 conn(0x7f83180b2cc0 msgr2=0x7f831815eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 shutdown_connections 2024-09-17T04:09:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.321+0000 7f831f120640 1 -- 172.21.15.104:0/3726861296 wait complete. 2024-09-17T04:09:39.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 -- 172.21.15.104:0/3357639762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 msgr2=0x7fb6f0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3357639762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb6f0004c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb708072180 tx=0x7fb6f0005830 comp rx=0 tx=0).stop 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 -- 172.21.15.104:0/3357639762 shutdown_connections 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3357639762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb6f0004c10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 -- 172.21.15.104:0/3357639762 >> 172.21.15.104:0/3357639762 conn(0x7fb7080735d0 msgr2=0x7fb7080739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:39.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 -- 172.21.15.104:0/3357639762 shutdown_connections 2024-09-17T04:09:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.463+0000 7fb70fbba640 1 -- 172.21.15.104:0/3357639762 wait complete. 2024-09-17T04:09:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.465+0000 7fb70fbba640 1 Processor -- start 2024-09-17T04:09:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.465+0000 7fb70fbba640 1 -- start start 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 0x7fb7080c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70815f5d0 0x7fb70815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb70806e180 con 0x7fb6f0004800 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb70806e000 con 0x7fb70815f5d0 2024-09-17T04:09:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70fbba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb70806f7b0 con 0x7fb70815ca90 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43358/0 (socket says 172.21.15.104:43358) 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 -- 172.21.15.104:0/3537405406 learned_addr learned my addr 172.21.15.104:0/3537405406 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d155640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 0x7fb7080c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70e157640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70815f5d0 0x7fb70815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 -- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 msgr2=0x7fb7080c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 0x7fb7080c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 -- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70815f5d0 msgr2=0x7fb70815f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70815f5d0 0x7fb70815f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d956640 1 -- 172.21.15.104:0/3537405406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb708161040 con 0x7fb6f0004800 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.466+0000 7fb70d155640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 0x7fb7080c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:39.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb70d956640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8004dc0 tx=0x7fb6f8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8017070 con 0x7fb6f0004800 2024-09-17T04:09:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f80108c0 con 0x7fb6f0004800 2024-09-17T04:09:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8001d40 con 0x7fb6f0004800 2024-09-17T04:09:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081612e0 con 0x7fb6f0004800 2024-09-17T04:09:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.467+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70815edd0 con 0x7fb6f0004800 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.468+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7080cf1f0 con 0x7fb6f0004800 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.468+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6f801a070 con 0x7fb6f0004800 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.469+0000 7fb7067fc640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 0x7fb6f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.469+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fb6f809a8d0 con 0x7fb6f0004800 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.469+0000 7fb70d155640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 0x7fb6f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.470+0000 7fb70d155640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 0x7fb6f407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc035000 tx=0x7fb6fc0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:39.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.474+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6f8062e90 con 0x7fb6f0004800 2024-09-17T04:09:39.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:39.683+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb70815d8c0 con 0x7fb6f0004800 2024-09-17T04:09:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.325+0000 7fb7067fc640 1 -- 172.21.15.104:0/3537405406 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb6f8062790 con 0x7fb6f0004800 2024-09-17T04:09:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T04:09:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 msgr2=0x7fb6f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 0x7fb6f407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc035000 tx=0x7fb6fc0046c0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 msgr2=0x7fb7080b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8004dc0 tx=0x7fb6f8001630 comp rx=0 tx=0).stop 2024-09-17T04:09:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 shutdown_connections 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb6f4078bc0 0x7fb6f407b0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb70815f5d0 0x7fb70815f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb70815ca90 0x7fb7080c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 --2- 172.21.15.104:0/3537405406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6f0004800 0x7fb7080b3720 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 >> 172.21.15.104:0/3537405406 conn(0x7fb7080735d0 msgr2=0x7fb7081ea1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 shutdown_connections 2024-09-17T04:09:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.329+0000 7fb70fbba640 1 -- 172.21.15.104:0/3537405406 wait complete. 2024-09-17T04:09:40.358 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-17T04:09:40.358 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 -- 172.21.15.104:0/915545870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580d0460 msgr2=0x7f9658161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 --2- 172.21.15.104:0/915545870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580d0460 0x7f9658161ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96580c7d70 tx=0x7f965402a530 comp rx=0 tx=0).stop 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 -- 172.21.15.104:0/915545870 shutdown_connections 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 --2- 172.21.15.104:0/915545870 >> v2:172.21.15.192:3300/0 conn(0x7f96580cf910 0x7f96580b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 --2- 172.21.15.104:0/915545870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580d0460 0x7f9658161ed0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 -- 172.21.15.104:0/915545870 >> 172.21.15.104:0/915545870 conn(0x7f96580d4510 msgr2=0x7f96580d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:40.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 -- 172.21.15.104:0/915545870 shutdown_connections 2024-09-17T04:09:40.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.478+0000 7f965f941640 1 -- 172.21.15.104:0/915545870 wait complete. 2024-09-17T04:09:40.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.480+0000 7f965f941640 1 Processor -- start 2024-09-17T04:09:40.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.480+0000 7f965f941640 1 -- start start 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 0x7f96581f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96580d0460 0x7f96580b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f96581629e0 con 0x7f96580cf910 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9658162860 con 0x7f96580d0460 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965f941640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9658162b60 con 0x7f96580b7b60 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43384/0 (socket says 172.21.15.104:43384) 2024-09-17T04:09:40.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 -- 172.21.15.104:0/1089219802 learned_addr learned my addr 172.21.15.104:0/1089219802 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965dede640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96580d0460 0x7f96580b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965d6dd640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 0x7f96581f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 -- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 msgr2=0x7f96581f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 0x7f96581f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 -- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96580d0460 msgr2=0x7f96580b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96580d0460 0x7f96580b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965cedc640 1 -- 172.21.15.104:0/1089219802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96581f9c70 con 0x7f96580cf910 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.481+0000 7f965d6dd640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 0x7f96581f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f965cedc640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f964800c3c0 tx=0x7f964800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648017070 con 0x7f96580cf910 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96480035f0 con 0x7f96580cf910 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96581f5b80 con 0x7f96580cf910 2024-09-17T04:09:40.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648003a80 con 0x7f96580cf910 2024-09-17T04:09:40.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.482+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96581f6140 con 0x7f96580cf910 2024-09-17T04:09:40.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.483+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96580d0250 con 0x7f96580cf910 2024-09-17T04:09:40.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.484+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f964801a070 con 0x7f96580cf910 2024-09-17T04:09:40.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.484+0000 7f964dffb640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 0x7f963c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:40.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.484+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9648099e80 con 0x7f96580cf910 2024-09-17T04:09:40.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.484+0000 7f965d6dd640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 0x7f963c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:40.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.485+0000 7f965d6dd640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 0x7f963c07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9654034000 tx=0x7f9654004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:40.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.489+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96580d0250 con 0x7f96580cf910 2024-09-17T04:09:40.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:40.671+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f96581f5910 con 0x7f96580cf910 2024-09-17T04:09:41.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.327+0000 7f964dffb640 1 -- 172.21.15.104:0/1089219802 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f96581f9c70 con 0x7f96580cf910 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 msgr2=0x7f963c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 0x7f963c07b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9654034000 tx=0x7f9654004730 comp rx=0 tx=0).stop 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 msgr2=0x7f96581f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f964800c3c0 tx=0x7f964800c880 comp rx=0 tx=0).stop 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 shutdown_connections 2024-09-17T04:09:41.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f963c078bc0 0x7f963c07b0d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96580d0460 0x7f96580b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96580cf910 0x7f96581f8520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 --2- 172.21.15.104:0/1089219802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96580b7b60 0x7f96581f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 >> 172.21.15.104:0/1089219802 conn(0x7f96580d4510 msgr2=0x7f96580d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 shutdown_connections 2024-09-17T04:09:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.331+0000 7f965f941640 1 -- 172.21.15.104:0/1089219802 wait complete. 2024-09-17T04:09:41.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T04:09:41.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 -- 172.21.15.104:0/224539564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 msgr2=0x7f014c06d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:41.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 --2- 172.21.15.104:0/224539564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c06d3a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f014c073430 tx=0x7f014402aac0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 -- 172.21.15.104:0/224539564 shutdown_connections 2024-09-17T04:09:41.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 --2- 172.21.15.104:0/224539564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c06d3a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 --2- 172.21.15.104:0/224539564 >> v2:172.21.15.192:3300/0 conn(0x7f014c0704e0 0x7f014c0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 -- 172.21.15.104:0/224539564 >> 172.21.15.104:0/224539564 conn(0x7f014c0d0900 msgr2=0x7f014c0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:41.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 -- 172.21.15.104:0/224539564 shutdown_connections 2024-09-17T04:09:41.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.471+0000 7f01525c6640 1 -- 172.21.15.104:0/224539564 wait complete. 2024-09-17T04:09:41.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.473+0000 7f01525c6640 1 Processor -- start 2024-09-17T04:09:41.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.473+0000 7f01525c6640 1 -- start start 2024-09-17T04:09:41.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:41.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f014c0b4a90 0x7f014c145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f014c1f6df0 0x7f014c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f014c069840 con 0x7f014c06cf90 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f014c0696c0 con 0x7f014c0b4a90 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f01525c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f014c0699c0 con 0x7f014c1f6df0 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f014bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f014bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43412/0 (socket says 172.21.15.104:43412) 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.474+0000 7f014bfff640 1 -- 172.21.15.104:0/293085332 learned_addr learned my addr 172.21.15.104:0/293085332 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 -- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f014c1f6df0 msgr2=0x7f014c153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f0150b63640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f014c1f6df0 0x7f014c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:41.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f014c1f6df0 0x7f014c153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014b7fe640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f014c0b4a90 0x7f014c145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 -- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f014c0b4a90 msgr2=0x7f014c145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f014c0b4a90 0x7f014c145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 -- 172.21.15.104:0/293085332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c1494c0 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f014bfff640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c3d0 tx=0x7f013c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c017070 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f013c0053c0 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c1497a0 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c003850 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.475+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1f68d0 con 0x7f014c06cf90 2024-09-17T04:09:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.476+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014c0b4ea0 con 0x7f014c06cf90 2024-09-17T04:09:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.477+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f013c01a070 con 0x7f014c06cf90 2024-09-17T04:09:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.477+0000 7f0148ff9640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 0x7f013807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.477+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7f013c09a1f0 con 0x7f014c06cf90 2024-09-17T04:09:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.478+0000 7f014b7fe640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 0x7f013807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.478+0000 7f014b7fe640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 0x7f013807b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f014c167980 tx=0x7f0140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.482+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f013c062500 con 0x7f014c06cf90 2024-09-17T04:09:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:41.660+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f014c06d820 con 0x7f014c06cf90 2024-09-17T04:09:43.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.360+0000 7f0148ff9640 1 -- 172.21.15.104:0/293085332 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7f013c061e00 con 0x7f014c06cf90 2024-09-17T04:09:43.360 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data_ec' created 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 msgr2=0x7f013807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 0x7f013807b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f014c167980 tx=0x7f0140008040 comp rx=0 tx=0).stop 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 msgr2=0x7f014c1422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c3d0 tx=0x7f013c00c890 comp rx=0 tx=0).stop 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 shutdown_connections 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0138078bc0 0x7f013807b0d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f014c0b4a90 0x7f014c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f014c1f6df0 0x7f014c153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 --2- 172.21.15.104:0/293085332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f014c06cf90 0x7f014c1422b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 >> 172.21.15.104:0/293085332 conn(0x7f014c0d0900 msgr2=0x7f014c14eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:43.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.363+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 shutdown_connections 2024-09-17T04:09:43.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.364+0000 7f01525c6640 1 -- 172.21.15.104:0/293085332 wait complete. 2024-09-17T04:09:43.384 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 -- 172.21.15.104:0/1394668167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 msgr2=0x7fdc0c15fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/1394668167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c15fae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0b2a20 tx=0x7fdbfc02a580 comp rx=0 tx=0).stop 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 -- 172.21.15.104:0/1394668167 shutdown_connections 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/1394668167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c06def0 0x7fdc0c06e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/1394668167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c15fae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/1394668167 >> v2:172.21.15.192:3300/0 conn(0x7fdc0c0b06e0 0x7fdc0c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 -- 172.21.15.104:0/1394668167 >> 172.21.15.104:0/1394668167 conn(0x7fdc0c09a9e0 msgr2=0x7fdc0c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 -- 172.21.15.104:0/1394668167 shutdown_connections 2024-09-17T04:09:43.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.505+0000 7fdc13b0b640 1 -- 172.21.15.104:0/1394668167 wait complete. 2024-09-17T04:09:43.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.507+0000 7fdc13b0b640 1 Processor -- start 2024-09-17T04:09:43.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.507+0000 7fdc13b0b640 1 -- start start 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c06def0 0x7fdc0c0d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c0b06e0 0x7fdc0c1f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ebd0 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ea50 con 0x7fdc0c06def0 2024-09-17T04:09:43.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c06ed50 con 0x7fdc0c0b06e0 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43424/0 (socket says 172.21.15.104:43424) 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 -- 172.21.15.104:0/2387167512 learned_addr learned my addr 172.21.15.104:0/2387167512 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc118a7640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c06def0 0x7fdc0c0d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc110a6640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c0b06e0 0x7fdc0c1f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 -- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c0b06e0 msgr2=0x7fdc0c1f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c0b06e0 0x7fdc0c1f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 -- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c06def0 msgr2=0x7fdc0c0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:43.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c06def0 0x7fdc0c0d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 -- 172.21.15.104:0/2387167512 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c1f4560 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc120a8640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400d8d0 tx=0x7fdc0400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04016070 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0400bd40 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c0cad60 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04003bd0 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.509+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c1f3820 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.511+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c0caad0 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.512+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc04024480 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.513+0000 7fdc027fc640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 0x7fdbf007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.513+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fdc0409b9a0 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.513+0000 7fdc118a7640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 0x7fdbf007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:43.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.513+0000 7fdc118a7640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 0x7fdbf007b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009b30 tx=0x7fdc08005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:43.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.516+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc04063550 con 0x7fdc0c15f6d0 2024-09-17T04:09:43.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:43.692+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fdc0c15f190 con 0x7fdc0c15f6d0 2024-09-17T04:09:44.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.361+0000 7fdc027fc640 1 -- 172.21.15.104:0/2387167512 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fdc04067f80 con 0x7fdc0c15f6d0 2024-09-17T04:09:44.361 INFO:teuthology.orchestra.run.smithi104.stderr:set pool 4 allow_ec_overwrites to true 2024-09-17T04:09:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 msgr2=0x7fdbf007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 0x7fdbf007b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009b30 tx=0x7fdc08005f90 comp rx=0 tx=0).stop 2024-09-17T04:09:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 msgr2=0x7fdc0c0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:44.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400d8d0 tx=0x7fdc0400dd90 comp rx=0 tx=0).stop 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 shutdown_connections 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdbf0078bc0 0x7fdbf007b0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0c15f6d0 0x7fdc0c0af030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc0c0b06e0 0x7fdc0c1f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 --2- 172.21.15.104:0/2387167512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0c06def0 0x7fdc0c0d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 >> 172.21.15.104:0/2387167512 conn(0x7fdc0c09a9e0 msgr2=0x7fdc0c0cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 shutdown_connections 2024-09-17T04:09:44.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.364+0000 7fdc13b0b640 1 -- 172.21.15.104:0/2387167512 wait complete. 2024-09-17T04:09:44.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-17T04:09:44.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 -- 172.21.15.104:0/1614948474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 msgr2=0x7f2b6c15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1614948474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c15ba80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005fd0 tx=0x7f2b5402a5d0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 -- 172.21.15.104:0/1614948474 shutdown_connections 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1614948474 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c15ba80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1614948474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c06def0 0x7f2b6c06f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 -- 172.21.15.104:0/1614948474 >> 172.21.15.104:0/1614948474 conn(0x7f2b6c0cdca0 msgr2=0x7f2b6c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 -- 172.21.15.104:0/1614948474 shutdown_connections 2024-09-17T04:09:44.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.508+0000 7f2b7287e640 1 -- 172.21.15.104:0/1614948474 wait complete. 2024-09-17T04:09:44.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.510+0000 7f2b7287e640 1 Processor -- start 2024-09-17T04:09:44.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.510+0000 7f2b7287e640 1 -- start start 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c06def0 0x7f2b6c1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c15bfc0 0x7f2b6c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c0b5a00 con 0x7f2b6c0b5260 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c0b5880 con 0x7f2b6c06def0 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b7287e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c071300 con 0x7f2b6c15bfc0 2024-09-17T04:09:44.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b63fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b63fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43444/0 (socket says 172.21.15.104:43444) 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.511+0000 7f2b63fff640 1 -- 172.21.15.104:0/1580354664 learned_addr learned my addr 172.21.15.104:0/1580354664 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b6bfff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c06def0 0x7f2b6c1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b70e1b640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c15bfc0 0x7f2b6c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 -- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c15bfc0 msgr2=0x7f2b6c1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c15bfc0 0x7f2b6c1f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 -- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c06def0 msgr2=0x7f2b6c1e5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c06def0 0x7f2b6c1e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 -- 172.21.15.104:0/1580354664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c1e4f70 con 0x7f2b6c0b5260 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b63fff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034040 tx=0x7f2b540038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5403e030 con 0x7f2b6c0b5260 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b54003ca0 con 0x7f2b6c0b5260 2024-09-17T04:09:44.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c1f77c0 con 0x7f2b6c0b5260 2024-09-17T04:09:44.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54035040 con 0x7f2b6c0b5260 2024-09-17T04:09:44.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.512+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c1e5510 con 0x7f2b6c0b5260 2024-09-17T04:09:44.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.513+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c1f7530 con 0x7f2b6c0b5260 2024-09-17T04:09:44.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.514+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b54041030 con 0x7f2b6c0b5260 2024-09-17T04:09:44.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.514+0000 7f2b697fa640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 0x7f2b4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:44.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.514+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f2b540bb620 con 0x7f2b6c0b5260 2024-09-17T04:09:44.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.514+0000 7f2b6bfff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 0x7f2b4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:44.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.515+0000 7f2b6bfff640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 0x7f2b4c07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005d00 tx=0x7f2b5c005c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:44.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.519+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b540837d0 con 0x7f2b6c0b5260 2024-09-17T04:09:44.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:44.730+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f2b6c06f410 con 0x7f2b6c0b5260 2024-09-17T04:09:45.308 INFO:tasks.ceph.mds.d.smithi192.stderr:2024-09-17T04:09:45.308+0000 7fa27ea4f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T04:09:45.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.380+0000 7f2b697fa640 1 -- 172.21.15.104:0/1580354664 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f2b540830d0 con 0x7f2b6c0b5260 2024-09-17T04:09:45.380 INFO:teuthology.orchestra.run.smithi104.stderr:added data pool 4 to fsmap 2024-09-17T04:09:45.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 msgr2=0x7f2b4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 0x7f2b4c07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005d00 tx=0x7f2b5c005c70 comp rx=0 tx=0).stop 2024-09-17T04:09:45.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 msgr2=0x7f2b6c145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034040 tx=0x7f2b540038a0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 shutdown_connections 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2b4c078b90 0x7f2b4c07b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b6c15bfc0 0x7f2b6c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b6c0b5260 0x7f2b6c145120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 --2- 172.21.15.104:0/1580354664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c06def0 0x7f2b6c1e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 >> 172.21.15.104:0/1580354664 conn(0x7f2b6c0cdca0 msgr2=0x7f2b6c068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 shutdown_connections 2024-09-17T04:09:45.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.383+0000 7f2b7287e640 1 -- 172.21.15.104:0/1580354664 wait complete. 2024-09-17T04:09:45.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:09:45.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 -- 172.21.15.104:0/107756709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 msgr2=0x7f43fc0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 --2- 172.21.15.104:0/107756709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0b43d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43fc06e3e0 tx=0x7f43e402a510 comp rx=0 tx=0).stop 2024-09-17T04:09:45.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 -- 172.21.15.104:0/107756709 shutdown_connections 2024-09-17T04:09:45.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 --2- 172.21.15.104:0/107756709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0b43d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 -- 172.21.15.104:0/107756709 >> 172.21.15.104:0/107756709 conn(0x7f43fc0b2cc0 msgr2=0x7f43fc0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:45.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 -- 172.21.15.104:0/107756709 shutdown_connections 2024-09-17T04:09:45.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.515+0000 7f4401f33640 1 -- 172.21.15.104:0/107756709 wait complete. 2024-09-17T04:09:45.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.517+0000 7f4401f33640 1 Processor -- start 2024-09-17T04:09:45.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.517+0000 7f4401f33640 1 -- start start 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43fc073d50 0x7f43fc1485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43fc0d0b40 0x7f43fc14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc15b960 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc15b7e0 con 0x7f43fc073d50 2024-09-17T04:09:45.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f4401f33640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc15bae0 con 0x7f43fc0d0b40 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43462/0 (socket says 172.21.15.104:43462) 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.518+0000 7f43f3fff640 1 -- 172.21.15.104:0/2671785189 learned_addr learned my addr 172.21.15.104:0/2671785189 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43fb7fe640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43fc073d50 0x7f43fc1485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 -- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43fc0d0b40 msgr2=0x7f43fc14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43fc0d0b40 0x7f43fc14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 -- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43fc073d50 msgr2=0x7f43fc1485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43fc073d50 0x7f43fc1485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 -- 172.21.15.104:0/2671785189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0c8070 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f3fff640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009780 tx=0x7f43e4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4031d60 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc0c8350 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43e4005020 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4005470 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.519+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc0c8910 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.520+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc15bff0 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.521+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43e40047a0 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.521+0000 7f43f8ff9640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 0x7f43dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.521+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f43e40bc360 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.521+0000 7f43fb7fe640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 0x7f43dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.522+0000 7f43fb7fe640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 0x7f43dc07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f60 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.525+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43e403f030 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.732+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43fc074420 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.733+0000 7f43f8ff9640 1 -- 172.21.15.104:0/2671785189 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7f43e4084470 con 0x7f43fc0b3fc0 2024-09-17T04:09:45.733 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:45.733 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T04:09:45:372806+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:44.731816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:09:45.733 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T04:09:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 msgr2=0x7f43dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 0x7f43dc07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f60 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 msgr2=0x7f43fc0a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009780 tx=0x7f43e4033d60 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 shutdown_connections 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f43dc078b90 0x7f43dc07b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43fc0d0b40 0x7f43fc14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43fc0b3fc0 0x7f43fc0a9850 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 --2- 172.21.15.104:0/2671785189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43fc073d50 0x7f43fc1485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 >> 172.21.15.104:0/2671785189 conn(0x7f43fc0b2cc0 msgr2=0x7f43fc15eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 shutdown_connections 2024-09-17T04:09:45.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.735+0000 7f4401f33640 1 -- 172.21.15.104:0/2671785189 wait complete. 2024-09-17T04:09:45.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 -- 172.21.15.104:0/1361426704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8400d19f0 msgr2=0x7fa84015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 --2- 172.21.15.104:0/1361426704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8400d19f0 0x7fa84015cf20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8400b3cf0 tx=0x7fa82802a530 comp rx=0 tx=0).stop 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 -- 172.21.15.104:0/1361426704 shutdown_connections 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 --2- 172.21.15.104:0/1361426704 >> v2:172.21.15.192:3300/0 conn(0x7fa8400b6250 0x7fa8400b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 --2- 172.21.15.104:0/1361426704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8400d19f0 0x7fa84015cf20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 -- 172.21.15.104:0/1361426704 >> 172.21.15.104:0/1361426704 conn(0x7fa8400d2350 msgr2=0x7fa8400d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 -- 172.21.15.104:0/1361426704 shutdown_connections 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.858+0000 7fa844aa4640 1 -- 172.21.15.104:0/1361426704 wait complete. 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.860+0000 7fa844aa4640 1 Processor -- start 2024-09-17T04:09:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.860+0000 7fa844aa4640 1 -- start start 2024-09-17T04:09:45.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8400b6250 0x7fa84014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8400d19f0 0x7fa84013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400b6d20 con 0x7fa84015cb10 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400b6ba0 con 0x7fa8400d19f0 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.861+0000 7fa844aa4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400b6ea0 con 0x7fa8400b6250 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43480/0 (socket says 172.21.15.104:43480) 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 -- 172.21.15.104:0/784688057 learned_addr learned my addr 172.21.15.104:0/784688057 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83e59c640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8400b6250 0x7fa84014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83dd9b640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8400d19f0 0x7fa84013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 -- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8400b6250 msgr2=0x7fa84014c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8400b6250 0x7fa84014c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 -- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8400d19f0 msgr2=0x7fa84013fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8400d19f0 0x7fa84013fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 -- 172.21.15.104:0/784688057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84014c6c0 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa83ed9d640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa838005d00 tx=0x7fa83800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838017070 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa838005330 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84014a820 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8380047a0 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.862+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84014ade0 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.863+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8400b7350 con 0x7fa84015cb10 2024-09-17T04:09:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.864+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa838004940 con 0x7fa84015cb10 2024-09-17T04:09:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.864+0000 7fa836ffd640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 0x7fa82007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.864+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa83809b040 con 0x7fa84015cb10 2024-09-17T04:09:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.864+0000 7fa83e59c640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 0x7fa82007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.865+0000 7fa83e59c640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 0x7fa82007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa830002200 tx=0x7fa8300019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:45.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:45.869+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa838062af0 con 0x7fa84015cb10 2024-09-17T04:09:46.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.045+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8400b56b0 con 0x7fa84015cb10 2024-09-17T04:09:46.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.046+0000 7fa836ffd640 1 -- 172.21.15.104:0/784688057 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7fa838067520 con 0x7fa84015cb10 2024-09-17T04:09:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:46.083 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:46.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 msgr2=0x7fa82007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 0x7fa82007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa830002200 tx=0x7fa8300019f0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 msgr2=0x7fa8401f6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa838005d00 tx=0x7fa83800dae0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 shutdown_connections 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa820078b90 0x7fa82007b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8400d19f0 0x7fa84013fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa84015cb10 0x7fa8401f6ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 --2- 172.21.15.104:0/784688057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8400b6250 0x7fa84014c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 >> 172.21.15.104:0/784688057 conn(0x7fa8400d2350 msgr2=0x7fa84015e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 shutdown_connections 2024-09-17T04:09:46.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.048+0000 7fa844aa4640 1 -- 172.21.15.104:0/784688057 wait complete. 2024-09-17T04:09:46.086 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 -- 172.21.15.104:0/3079533526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a9815b5f0 msgr2=0x7f4a9806ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/3079533526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a9815b5f0 0x7f4a9806ff00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4a88005fd0 tx=0x7f4a8802a540 comp rx=0 tx=0).stop 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 -- 172.21.15.104:0/3079533526 shutdown_connections 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/3079533526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 0x7f4a98073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/3079533526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a9815b5f0 0x7f4a9806ff00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 -- 172.21.15.104:0/3079533526 >> 172.21.15.104:0/3079533526 conn(0x7f4a980d1140 msgr2=0x7f4a980d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 -- 172.21.15.104:0/3079533526 shutdown_connections 2024-09-17T04:09:46.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.200+0000 7f4a9dd90640 1 -- 172.21.15.104:0/3079533526 wait complete. 2024-09-17T04:09:46.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.201+0000 7f4a9dd90640 1 Processor -- start 2024-09-17T04:09:46.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.202+0000 7f4a9dd90640 1 -- start start 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 0x7f4a98159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 0x7f4a981f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4a980ae770 con 0x7f4a980cf130 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4a980ae5f0 con 0x7f4a9815b5f0 2024-09-17T04:09:46.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a9dd90640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4a980ae8f0 con 0x7f4a9815efb0 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43498/0 (socket says 172.21.15.104:43498) 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 -- 172.21.15.104:0/1791859246 learned_addr learned my addr 172.21.15.104:0/1791859246 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a8effd640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 0x7f4a98159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a97fff640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 0x7f4a981f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 -- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 msgr2=0x7f4a981f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 0x7f4a981f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 -- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 msgr2=0x7f4a98159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 0x7f4a98159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a977fe640 1 -- 172.21.15.104:0/1791859246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a981f39c0 con 0x7f4a980cf130 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.203+0000 7f4a8effd640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 0x7f4a98159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:46.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a977fe640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034040 tx=0x7f4a88003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8803e030 con 0x7f4a980cf130 2024-09-17T04:09:46.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a88003e00 con 0x7f4a980cf130 2024-09-17T04:09:46.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a981f3ca0 con 0x7f4a980cf130 2024-09-17T04:09:46.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88035040 con 0x7f4a980cf130 2024-09-17T04:09:46.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.204+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9809b4d0 con 0x7f4a980cf130 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.205+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9809b730 con 0x7f4a980cf130 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.206+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a88041030 con 0x7f4a980cf130 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.206+0000 7f4a94ff9640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 0x7f4a7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.206+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4a880bb820 con 0x7f4a980cf130 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.206+0000 7f4a8effd640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 0x7f4a7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.207+0000 7f4a8effd640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 0x7f4a7807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a980c76d0 tx=0x7f4a80005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.211+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a88083920 con 0x7f4a980cf130 2024-09-17T04:09:46.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.387+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a981f6840 con 0x7f4a980cf130 2024-09-17T04:09:46.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.388+0000 7f4a94ff9640 1 -- 172.21.15.104:0/1791859246 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7f4a88083220 con 0x7f4a980cf130 2024-09-17T04:09:46.388 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:46.389 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 msgr2=0x7f4a7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 0x7f4a7807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a980c76d0 tx=0x7f4a80005f10 comp rx=0 tx=0).stop 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 msgr2=0x7f4a9809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034040 tx=0x7f4a88003910 comp rx=0 tx=0).stop 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 shutdown_connections 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4a78078bc0 0x7f4a7807b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a9815b5f0 0x7f4a98159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a9815efb0 0x7f4a981f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 --2- 172.21.15.104:0/1791859246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a980cf130 0x7f4a9809ae20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 >> 172.21.15.104:0/1791859246 conn(0x7f4a980d1140 msgr2=0x7f4a980adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 shutdown_connections 2024-09-17T04:09:46.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.391+0000 7f4a9dd90640 1 -- 172.21.15.104:0/1791859246 wait complete. 2024-09-17T04:09:46.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 -- 172.21.15.104:0/258364463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8858005270 msgr2=0x7f885800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 --2- 172.21.15.104:0/258364463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8858005270 0x7f885800b9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8868005fd0 tx=0x7f8858005830 comp rx=0 tx=0).stop 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 -- 172.21.15.104:0/258364463 shutdown_connections 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 --2- 172.21.15.104:0/258364463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8858005270 0x7f885800b9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 -- 172.21.15.104:0/258364463 >> 172.21.15.104:0/258364463 conn(0x7f88700b6b20 msgr2=0x7f88700d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 -- 172.21.15.104:0/258364463 shutdown_connections 2024-09-17T04:09:46.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.532+0000 7f88748b6640 1 -- 172.21.15.104:0/258364463 wait complete. 2024-09-17T04:09:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.534+0000 7f88748b6640 1 Processor -- start 2024-09-17T04:09:46.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.534+0000 7f88748b6640 1 -- start start 2024-09-17T04:09:46.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8858005270 0x7f88700aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88701569b0 0x7f887014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88700d24d0 con 0x7f8870160e10 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f887015fae0 con 0x7f88701569b0 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f88748b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88700d2650 con 0x7f8858005270 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54900/0 (socket says 172.21.15.104:54900) 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 -- 172.21.15.104:0/3715978283 learned_addr learned my addr 172.21.15.104:0/3715978283 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886dd9b640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88701569b0 0x7f887014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886e59c640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8858005270 0x7f88700aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 -- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8858005270 msgr2=0x7f88700aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8858005270 0x7f88700aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 -- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88701569b0 msgr2=0x7f887014b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88701569b0 0x7f887014b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.535+0000 7f886ed9d640 1 -- 172.21.15.104:0/3715978283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8870161760 con 0x7f8870160e10 2024-09-17T04:09:46.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f886ed9d640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f886802aec0 tx=0x7f8868004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868009200 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8868041070 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88701577b0 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868009ad0 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.536+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8870157a90 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.537+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88700b9330 con 0x7f8870160e10 2024-09-17T04:09:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.538+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8868046460 con 0x7f8870160e10 2024-09-17T04:09:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.538+0000 7f885effd640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 0x7f885007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.538+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f88680bbff0 con 0x7f8870160e10 2024-09-17T04:09:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.538+0000 7f886e59c640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 0x7f885007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.539+0000 7f886e59c640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 0x7f885007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8860001890 tx=0x7f8860006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.542+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88700b9330 con 0x7f8870160e10 2024-09-17T04:09:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.750+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8870050f60 con 0x7f8870160e10 2024-09-17T04:09:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.751+0000 7f885effd640 1 -- 172.21.15.104:0/3715978283 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7f8870050f60 con 0x7f8870160e10 2024-09-17T04:09:46.751 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:46.751 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T04:09:45:372806+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:44.731816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:09:46.752 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T04:09:46.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 msgr2=0x7f885007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 0x7f885007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8860001890 tx=0x7f8860006720 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 msgr2=0x7f8870161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f886802aec0 tx=0x7f8868004250 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 shutdown_connections 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8850078b90 0x7f885007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88701569b0 0x7f887014b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8870160e10 0x7f8870161220 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 --2- 172.21.15.104:0/3715978283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8858005270 0x7f88700aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 >> 172.21.15.104:0/3715978283 conn(0x7f88700b6b20 msgr2=0x7f887006d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.753+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 shutdown_connections 2024-09-17T04:09:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.754+0000 7f88748b6640 1 -- 172.21.15.104:0/3715978283 wait complete. 2024-09-17T04:09:46.764 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:46.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 -- 172.21.15.104:0/3072195359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 msgr2=0x7f27400b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 --2- 172.21.15.104:0/3072195359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f27400b2e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2738009830 tx=0x7f273802a540 comp rx=0 tx=0).stop 2024-09-17T04:09:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 -- 172.21.15.104:0/3072195359 shutdown_connections 2024-09-17T04:09:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 --2- 172.21.15.104:0/3072195359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f27400b2e60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 -- 172.21.15.104:0/3072195359 >> 172.21.15.104:0/3072195359 conn(0x7f27400d4440 msgr2=0x7f27400d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 -- 172.21.15.104:0/3072195359 shutdown_connections 2024-09-17T04:09:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.875+0000 7f2744bda640 1 -- 172.21.15.104:0/3072195359 wait complete. 2024-09-17T04:09:46.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.877+0000 7f2744bda640 1 Processor -- start 2024-09-17T04:09:46.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.877+0000 7f2744bda640 1 -- start start 2024-09-17T04:09:46.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f2740157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2740162590 0x7f27400c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27400b3730 con 0x7f27400cfe00 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27400b35b0 con 0x7f27400b4f70 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f27400b38b0 con 0x7f2740162590 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54910/0 (socket says 172.21.15.104:54910) 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 -- 172.21.15.104:0/3804529769 learned_addr learned my addr 172.21.15.104:0/3804529769 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273e59c640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f2740157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273ed9d640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2740162590 0x7f27400c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 -- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2740162590 msgr2=0x7f27400c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2740162590 0x7f27400c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 -- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 msgr2=0x7f2740157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f2740157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 -- 172.21.15.104:0/3804529769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27401f9880 con 0x7f27400cfe00 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f273dd9b640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f273400c4d0 tx=0x7f273400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734016020 con 0x7f27400cfe00 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2734012920 con 0x7f27400cfe00 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27401f9b60 con 0x7f27400cfe00 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2734012d30 con 0x7f27400cfe00 2024-09-17T04:09:46.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.879+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274014f1a0 con 0x7f27400cfe00 2024-09-17T04:09:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.880+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27400b2e60 con 0x7f27400cfe00 2024-09-17T04:09:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.881+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2734019020 con 0x7f27400cfe00 2024-09-17T04:09:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.881+0000 7f272effd640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 0x7f272007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.882+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f273409b150 con 0x7f27400cfe00 2024-09-17T04:09:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.882+0000 7f273e59c640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 0x7f272007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.882+0000 7f273e59c640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 0x7f272007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27300014a0 tx=0x7f2730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:46.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:46.886+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2734020020 con 0x7f27400cfe00 2024-09-17T04:09:47.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.062+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2740158f90 con 0x7f27400cfe00 2024-09-17T04:09:47.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.063+0000 7f272effd640 1 -- 172.21.15.104:0/3804529769 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7f2734063260 con 0x7f27400cfe00 2024-09-17T04:09:47.063 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:47.063 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:47.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 msgr2=0x7f272007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 0x7f272007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27300014a0 tx=0x7f2730009040 comp rx=0 tx=0).stop 2024-09-17T04:09:47.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 msgr2=0x7f27401f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f273400c4d0 tx=0x7f273400c990 comp rx=0 tx=0).stop 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 shutdown_connections 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2720078b90 0x7f272007b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2740162590 0x7f27400c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27400cfe00 0x7f27401f5430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 --2- 172.21.15.104:0/3804529769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27400b4f70 0x7f2740157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 >> 172.21.15.104:0/3804529769 conn(0x7f27400d4440 msgr2=0x7f274015eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 shutdown_connections 2024-09-17T04:09:47.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.065+0000 7f2744bda640 1 -- 172.21.15.104:0/3804529769 wait complete. 2024-09-17T04:09:47.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:09:39.684542+0000', 'modified': '2024-09-17T04:09:44.731816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4425}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4425': {'gid': 4425, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/4000193285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 4000193285}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 4000193285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4425, 'qdb_cluster': [4425]} 2024-09-17T04:09:47.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T04:09:47.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T04:09:47.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.594+0000 7f198084d640 1 -- 172.21.15.104:0/76809396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 msgr2=0x7f197c0d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.594+0000 7f198084d640 1 --2- 172.21.15.104:0/76809396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c0d0be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f197c0d2080 tx=0x7f196402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 -- 172.21.15.104:0/76809396 shutdown_connections 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 --2- 172.21.15.104:0/76809396 >> v2:172.21.15.192:3300/0 conn(0x7f197c0d1120 0x7f197c0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 --2- 172.21.15.104:0/76809396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c0d0be0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 -- 172.21.15.104:0/76809396 >> 172.21.15.104:0/76809396 conn(0x7f197c09d830 msgr2=0x7f197c0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 -- 172.21.15.104:0/76809396 shutdown_connections 2024-09-17T04:09:47.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.595+0000 7f198084d640 1 -- 172.21.15.104:0/76809396 wait complete. 2024-09-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.597+0000 7f198084d640 1 Processor -- start 2024-09-17T04:09:47.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.597+0000 7f198084d640 1 -- start start 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197c0d1120 0x7f197c0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197c15ee80 0x7f197c0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0b6700 con 0x7f197c0d0170 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0b6580 con 0x7f197c15ee80 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f198084d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f197c0b6880 con 0x7f197c0d1120 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54936/0 (socket says 172.21.15.104:54936) 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 -- 172.21.15.104:0/1409996060 learned_addr learned my addr 172.21.15.104:0/1409996060 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197c0d1120 0x7f197c0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197ad9d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197c15ee80 0x7f197c0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 -- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197c0d1120 msgr2=0x7f197c0b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197c0d1120 0x7f197c0b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 -- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197c15ee80 msgr2=0x7f197c0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197c15ee80 0x7f197c0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.598+0000 7f197a59c640 1 -- 172.21.15.104:0/1409996060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c06cf60 con 0x7f197c0d0170 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f197a59c640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c3f0 tx=0x7f196c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f19737fe640 1 -- 172.21.15.104:0/1409996060 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c017070 con 0x7f197c0d0170 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f19737fe640 1 -- 172.21.15.104:0/1409996060 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f196c0035f0 con 0x7f197c0d0170 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c06d240 con 0x7f197c0d0170 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f19737fe640 1 -- 172.21.15.104:0/1409996060 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c003a40 con 0x7f197c0d0170 2024-09-17T04:09:47.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.599+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c06d800 con 0x7f197c0d0170 2024-09-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.600+0000 7f19737fe640 1 -- 172.21.15.104:0/1409996060 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f196c01a070 con 0x7f197c0d0170 2024-09-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.601+0000 7f19737fe640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 0x7f195c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.601+0000 7f19737fe640 1 -- 172.21.15.104:0/1409996060 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f196c09a430 con 0x7f197c0d0170 2024-09-17T04:09:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.602+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 0x7f195c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.602+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 0x7f195c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1964034000 tx=0x7f1964004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.602+0000 7f19877bb740 1 Processor -- start 2024-09-17T04:09:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.602+0000 7f19877bb740 1 -- start start 2024-09-17T04:09:47.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 0x55557a60ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a2153b0 0x55557a6104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55557a558820 con 0x55557a21d590 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55557a547c50 con 0x55557a2153b0 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55557a54ba60 con 0x55557a23e270 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54944/0 (socket says 172.21.15.104:54944) 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 -- 172.21.15.104:0/1965003822 learned_addr learned my addr 172.21.15.104:0/1965003822 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197a59c640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 0x55557a60ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a2153b0 0x55557a6104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 -- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 msgr2=0x55557a60ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 0x55557a60ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 -- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a2153b0 msgr2=0x55557a6104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a2153b0 0x55557a6104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 -- 172.21.15.104:0/1965003822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557a2a9850 con 0x55557a21d590 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197a59c640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 0x55557a60ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f197ad9d640 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f197400a430 tx=0x7f1974009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b130e5373d72ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f195bfff640 1 -- 172.21.15.104:0/1965003822 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974013790 con 0x55557a21d590 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f195bfff640 1 -- 172.21.15.104:0/1965003822 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1974019070 con 0x55557a21d590 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.604+0000 7f195bfff640 1 -- 172.21.15.104:0/1965003822 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974013bd0 con 0x55557a21d590 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 -- 172.21.15.104:0/1965003822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 msgr2=0x55557a62d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f197400a430 tx=0x7f1974009650 comp rx=0 tx=0).stop 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 -- 172.21.15.104:0/1965003822 shutdown_connections 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a2153b0 0x55557a6104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62d3e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 --2- 172.21.15.104:0/1965003822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a23e270 0x55557a60ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 -- 172.21.15.104:0/1965003822 >> 172.21.15.104:0/1965003822 conn(0x55557a2323c0 msgr2=0x55557a5e6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 -- 172.21.15.104:0/1965003822 shutdown_connections 2024-09-17T04:09:47.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.605+0000 7f19877bb740 1 -- 172.21.15.104:0/1965003822 wait complete. 2024-09-17T04:09:47.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.606+0000 7f19877bb740 1 -- start start 2024-09-17T04:09:47.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.606+0000 7f19877bb740 1 Processor -- start 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a620ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a23e270 0x55557a62add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55557a2b8620 con 0x55557a21d590 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55557a4ed5f0 con 0x55557a23e270 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55557a610a20 con 0x55557a2153b0 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19877bb740 10 client.0 _ll_register_callbacks cb 0x55557a4f10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54956/0 (socket says 172.21.15.104:54956) 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 -- 172.21.15.104:0/1653488880 learned_addr learned my addr 172.21.15.104:0/1653488880 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f197a59c640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a620ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f197ad9d640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a23e270 0x55557a62add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 -- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 msgr2=0x55557a620ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a620ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 -- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a23e270 msgr2=0x55557a62add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a23e270 0x55557a62add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 -- 172.21.15.104:0/1653488880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557a3206b0 con 0x55557a21d590 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f1971d9b640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19640099d0 tx=0x7f19640091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f67dbb25973939e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.608+0000 7f19597fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964005750 con 0x55557a21d590 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1964004050 con 0x55557a21d590 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1974019070 con 0x55557a21d590 2024-09-17T04:09:47.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f1964004250 con 0x55557a21d590 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 10 client.4554 fetch_fsmap learned FSMap version 7 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55557a63b060 con 0x55557a21d590 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1974019070 con 0x55557a21d590 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f19640035f0 con 0x55557a21d590 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 10 client.4554 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 10 client.4554 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 20 client.4554 populate_metadata read hostname 'smithi104' 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1fce40 0x55557a639f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 4 client.4554 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 --> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55557a55a770 con 0x55557a1fce40 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.609+0000 7f197a59c640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1fce40 0x55557a639f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.610+0000 7f19597fa640 10 client.4554 ms_handle_connect on v2:172.21.15.192:6835/4000193285 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.610+0000 7f197a59c640 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1fce40 0x55557a639f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2b6fa9b2b40ece server_cookie=a8fcf83dcc29f4ce in_seq=0 out_seq=0 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19597fa640 1 -- 172.21.15.104:0/1653488880 <== mds.0 v2:172.21.15.192:6835/4000193285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55557a55a770 con 0x55557a1fce40 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19597fa640 10 client.4554 handle_command_reply: tid=0 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 client.4554 shutdown 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 msgr2=0x55557a62a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f19640099d0 tx=0x7f19640091e0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 shutdown_connections 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1fce40 0x55557a639f30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a23e270 0x55557a62add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19597fa640 0 client.4554 ms_handle_reset on v2:172.21.15.192:6835/4000193285 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a21d590 0x55557a62a890 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 --2- 172.21.15.104:0/1653488880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a620ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 >> 172.21.15.104:0/1653488880 conn(0x55557a2323c0 msgr2=0x55557a5e0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 shutdown_connections 2024-09-17T04:09:47.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 1 -- 172.21.15.104:0/1653488880 wait complete. 2024-09-17T04:09:47.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.611+0000 7f19877bb740 20 client.4554 trim_cache size 0 max 16384 2024-09-17T04:09:47.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.629+0000 7f19877bb740 1 Processor -- start 2024-09-17T04:09:47.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.629+0000 7f19877bb740 1 -- start start 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a62a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a6435b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f197c2025b0 con 0x55557a1fce40 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f197c201910 con 0x55557a21d590 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.630+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f197c201f60 con 0x55557a2153b0 2024-09-17T04:09:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54962/0 (socket says 172.21.15.104:54962) 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 -- 172.21.15.104:0/2877263284 learned_addr learned my addr 172.21.15.104:0/2877263284 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 -- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 msgr2=0x55557a62a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a62a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 -- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 msgr2=0x55557a6435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a6435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 -- 172.21.15.104:0/2877263284 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557a5e2120 con 0x55557a1fce40 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f197a59c640 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f196c000fb0 tx=0x7f196c098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b365defcfe410d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f195b7fe640 1 -- 172.21.15.104:0/2877263284 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c09a0d0 con 0x55557a1fce40 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f195b7fe640 1 -- 172.21.15.104:0/2877263284 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f196c05e0c0 con 0x55557a1fce40 2024-09-17T04:09:47.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.631+0000 7f195b7fe640 1 -- 172.21.15.104:0/2877263284 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c06b2a0 con 0x55557a1fce40 2024-09-17T04:09:47.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 -- 172.21.15.104:0/2877263284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 msgr2=0x55557a5e0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f196c000fb0 tx=0x7f196c098450 comp rx=0 tx=0).stop 2024-09-17T04:09:47.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 -- 172.21.15.104:0/2877263284 shutdown_connections 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a6435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a62a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 --2- 172.21.15.104:0/2877263284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a5e0f00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 -- 172.21.15.104:0/2877263284 >> 172.21.15.104:0/2877263284 conn(0x55557a2323c0 msgr2=0x55557a639120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 -- 172.21.15.104:0/2877263284 shutdown_connections 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.632+0000 7f19877bb740 1 -- 172.21.15.104:0/2877263284 wait complete. 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.633+0000 7f19877bb740 1 -- start start 2024-09-17T04:09:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.633+0000 7f19877bb740 1 Processor -- start 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a639120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a639660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55557a63dda0 con 0x55557a1fce40 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55557a63d950 con 0x55557a21d590 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55557a6240d0 con 0x55557a2153b0 2024-09-17T04:09:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f19877bb740 10 client.0 _ll_register_callbacks cb 0x7f1964009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f197a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54978/0 (socket says 172.21.15.104:54978) 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.634+0000 7f197a59c640 1 -- 172.21.15.104:0/3366084144 learned_addr learned my addr 172.21.15.104:0/3366084144 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197ad9d640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a639660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f1971d9b640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a639120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 -- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 msgr2=0x55557a639120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a639120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 -- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 msgr2=0x55557a639660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a639660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 -- 172.21.15.104:0/3366084144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557a6ae710 con 0x55557a1fce40 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f197a59c640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f196c061b50 tx=0x7f196c0882f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24af5d67577d5db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T04:09:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c070060 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f196c06b4a0 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196c05e0c0 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f196c076050 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 10 client.4560 fetch_fsmap learned FSMap version 7 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55557a5fdf80 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f196c05e0c0 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f196c069b70 con 0x55557a1fce40 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 10 client.4560 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 10 client.4560 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 20 client.4560 populate_metadata read hostname 'smithi104' 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1d2280 0x55557a6aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 4 client.4560 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:09:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.635+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 --> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] -- command(tid 0: {"prefix": "status"}) -- 0x55557a556220 con 0x55557a1d2280 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f1971d9b640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1d2280 0x55557a6aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19597fa640 10 client.4560 ms_handle_connect on v2:172.21.15.192:6835/4000193285 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f1971d9b640 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1d2280 0x55557a6aa500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4de76babf131bd6 server_cookie=bbbd298f90f53fbe in_seq=0 out_seq=0 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19597fa640 1 -- 172.21.15.104:0/3366084144 <== mds.0 v2:172.21.15.192:6835/4000193285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55557a556220 con 0x55557a1d2280 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19597fa640 10 client.4560 handle_command_reply: tid=0 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 client.4560 shutdown 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 msgr2=0x55557a693270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f196c061b50 tx=0x7f196c0882f0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 shutdown_connections 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x55557a1d2280 0x55557a6aa500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55557a21d590 0x55557a639660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55557a2153b0 0x55557a639120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 --2- 172.21.15.104:0/3366084144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55557a1fce40 0x55557a693270 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19597fa640 0 client.4560 ms_handle_reset on v2:172.21.15.192:6835/4000193285 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.636+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 >> 172.21.15.104:0/3366084144 conn(0x55557a2323c0 msgr2=0x55557a620690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 shutdown_connections 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f19877bb740 1 -- 172.21.15.104:0/3366084144 wait complete. 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f19877bb740 20 client.4560 trim_cache size 0 max 16384 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "6f80e9a4-ab66-4103-911e-380249777ecb", 2024-09-17T04:09:47.642 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4425, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 7.3101247039999997, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 7, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 27, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 27, 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 13.326843439999999 2024-09-17T04:09:47.643 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 msgr2=0x7f195c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 0x7f195c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1964034000 tx=0x7f1964004730 comp rx=0 tx=0).stop 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 msgr2=0x7f197c14f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c3f0 tx=0x7f196c00c8b0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 shutdown_connections 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078b90 0x7f195c07b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197c15ee80 0x7f197c0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197c0d1120 0x7f197c0b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 --2- 172.21.15.104:0/1409996060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f197c0d0170 0x7f197c14f970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 >> 172.21.15.104:0/1409996060 conn(0x7f197c09d830 msgr2=0x7f197c15d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 shutdown_connections 2024-09-17T04:09:47.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.637+0000 7f198084d640 1 -- 172.21.15.104:0/1409996060 wait complete. 2024-09-17T04:09:47.648 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:09:47.648 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:47.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 -- 172.21.15.104:0/505100150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7304003a50 msgr2=0x7f7304003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 --2- 172.21.15.104:0/505100150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7304003a50 0x7f7304003ec0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7314006fc0 tx=0x7f7304005830 comp rx=0 tx=0).stop 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 -- 172.21.15.104:0/505100150 shutdown_connections 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 --2- 172.21.15.104:0/505100150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7304003a50 0x7f7304003ec0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 -- 172.21.15.104:0/505100150 >> 172.21.15.104:0/505100150 conn(0x7f73180d4620 msgr2=0x7f73180d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 -- 172.21.15.104:0/505100150 shutdown_connections 2024-09-17T04:09:47.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.761+0000 7f731f7c3640 1 -- 172.21.15.104:0/505100150 wait complete. 2024-09-17T04:09:47.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.763+0000 7f731f7c3640 1 Processor -- start 2024-09-17T04:09:47.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.763+0000 7f731f7c3640 1 -- start start 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7304003a50 0x7f731815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7318161a40 0x7f73181534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f73180d36f0 con 0x7f7318154580 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73180d3570 con 0x7f7318161a40 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731f7c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f73180d3870 con 0x7f7304003a50 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54994/0 (socket says 172.21.15.104:54994) 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 -- 172.21.15.104:0/3872950256 learned_addr learned my addr 172.21.15.104:0/3872950256 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731dd60640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7318161a40 0x7f73181534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731d55f640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7304003a50 0x7f731815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 -- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7304003a50 msgr2=0x7f731815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7304003a50 0x7f731815a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 -- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7318161a40 msgr2=0x7f73181534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7318161a40 0x7f73181534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 -- 172.21.15.104:0/3872950256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73181f9660 con 0x7f7318154580 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f731cd5e640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7308003e40 tx=0x7f7308001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308015070 con 0x7f7318154580 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.764+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7308011840 con 0x7f7318154580 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.765+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308011cd0 con 0x7f7318154580 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.765+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7318159900 con 0x7f7318154580 2024-09-17T04:09:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.765+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7318159ec0 con 0x7f7318154580 2024-09-17T04:09:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.766+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7318162a80 con 0x7f7318154580 2024-09-17T04:09:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.766+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7308018070 con 0x7f7318154580 2024-09-17T04:09:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.767+0000 7f730dffb640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 0x7f72fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.767+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f730809bb20 con 0x7f7318154580 2024-09-17T04:09:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.767+0000 7f731d55f640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 0x7f72fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:47.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.767+0000 7f731d55f640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 0x7f72fc07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7314033000 tx=0x7f73180cf4e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:47.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.771+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7308063660 con 0x7f7318154580 2024-09-17T04:09:47.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.981+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f731806ce80 con 0x7f7318154580 2024-09-17T04:09:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.981+0000 7f730dffb640 1 -- 172.21.15.104:0/3872950256 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f7308068090 con 0x7f7318154580 2024-09-17T04:09:47.981 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T04:09:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 msgr2=0x7f72fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 0x7f72fc07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7314033000 tx=0x7f73180cf4e0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 msgr2=0x7f7318161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7308003e40 tx=0x7f7308001630 comp rx=0 tx=0).stop 2024-09-17T04:09:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 shutdown_connections 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72fc078b90 0x7f72fc07b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7318161a40 0x7f73181534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7318154580 0x7f7318161500 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 --2- 172.21.15.104:0/3872950256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7304003a50 0x7f731815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 >> 172.21.15.104:0/3872950256 conn(0x7f73180d4620 msgr2=0x7f73180d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 shutdown_connections 2024-09-17T04:09:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:47.983+0000 7f731f7c3640 1 -- 172.21.15.104:0/3872950256 wait complete. 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:09:47.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:09:47.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T04:09:47.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:47.995 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T04:09:48.010 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T04:09:48.011 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42794sec preferred_lft 42794sec 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T04:09:48.012 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:09:48.013 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:09:48.013 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:09:48.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:09:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:48.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:48.224 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:09:48.250 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T04:09:48.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:48.252 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T04:09:48.313 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T04:09:48.313 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:09:48.314 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:09:48.314 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:09:48.314 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:09:48.314 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:09:48.315 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:09:48.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:09:48.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:09:48.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:09:48.315 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:09:48.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:09:48.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:48.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:48.610 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:09:48.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:48.626 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-09-17T04:09:48.682 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:09:48.682 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:09:48.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:09:48.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-17T04:09:48.683 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:09:48.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:09:48.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:48.803 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-17T04:09:48.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-17T04:09:48.804 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:09:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:09:48.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:48.930 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:09:48.930 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:09:48.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T04:09:48.930 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:09:48.930 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:09:48.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:09:49.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:49.012 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-17T04:09:49.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:09:49.013 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:49.028 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T04:09:49.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:09:49.029 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:49.083 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-09-17T04:09:49.149 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:09:49.205 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-09-17T04:09:49.205 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-09-17T04:09:49.206 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T04:09:49.207 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T04:09:49.208 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-09-17T04:09:49.208 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:09:49.208 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:09:49.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:49.208 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-09-17T04:09:49.261 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T04:09:49.261 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-17T04:09:49.304 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-09-17T04:09:49.329 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T04:09:49.385 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-09-17T04:09:49.385 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-09-17T04:09:49.385 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-09-17T04:09:49.385 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-09-17T04:09:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-09-17T04:09:49.387 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:09:49.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:49.388 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-09-17T04:09:49.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi104.stderr:2024-09-17T04:09:49.422+0000 7f43b2786480 -1 init, newargv = 0x55a2cd60fc40 newargc=15 2024-09-17T04:09:49.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi104.stderr:ceph-fuse[43708]: starting ceph client 2024-09-17T04:09:49.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi104.stderr:ceph-fuse[43708]: starting fuse 2024-09-17T04:09:49.437 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-09-17T04:09:49.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-09-17T04:09:49.438 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T04:09:49.439 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.admin")) 2024-09-17T04:09:49.440 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T04:09:49.555 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.admin.43708.asok 2024-09-17T04:09:49.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:49.565 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43708.asok 2024-09-17T04:09:49.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:49.566 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43708.asok status 2024-09-17T04:09:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "admin", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "43708", 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-09-17T04:09:49.708 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4572, 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4572 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2845453243 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-09-17T04:09:49.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 2845453243 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4572 192.168.0.1:0/2845453243", 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/2845453243", 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 7, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 27, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-09-17T04:09:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:09:49.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:49.716 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-09-17T04:09:49.717 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-09-17T04:09:49.732 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:49.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:49.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:49.799 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-17T04:09:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:09:49.911 INFO:teuthology.orchestra.run.smithi104.stdout:# file: . 2024-09-17T04:09:49.912 INFO:teuthology.orchestra.run.smithi104.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-17T04:09:49.912 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:49.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:09:49.918 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:49.918 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:09:49.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:09:50.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 -- 172.21.15.104:0/819345906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 msgr2=0x7f0f7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/819345906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f7800b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009ed0 tx=0x7f0f78005830 comp rx=0 tx=0).stop 2024-09-17T04:09:50.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f8ffff640 1 -- 172.21.15.104:0/819345906 reap_dead start 2024-09-17T04:09:50.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 -- 172.21.15.104:0/819345906 shutdown_connections 2024-09-17T04:09:50.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 -- 172.21.15.104:0/819345906 >> 172.21.15.104:0/819345906 conn(0x7f0f900b1b90 msgr2=0x7f0f900b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:50.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 -- 172.21.15.104:0/819345906 shutdown_connections 2024-09-17T04:09:50.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.087+0000 7f0f95ba1640 1 -- 172.21.15.104:0/819345906 wait complete. 2024-09-17T04:09:50.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.089+0000 7f0f95ba1640 1 Processor -- start 2024-09-17T04:09:50.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.089+0000 7f0f95ba1640 1 -- start start 2024-09-17T04:09:50.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 0x7f0f901f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f901f2110 0x7f0f901f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90070d20 con 0x7f0f78005150 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90070ba0 con 0x7f0f900c6500 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9006e500 con 0x7f0f901f2110 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55006/0 (socket says 172.21.15.104:55006) 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 -- 172.21.15.104:0/1677401119 learned_addr learned my addr 172.21.15.104:0/1677401119 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8effd640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 0x7f0f901f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8ffff640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f901f2110 0x7f0f901f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 -- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f901f2110 msgr2=0x7f0f901f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f901f2110 0x7f0f901f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 -- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 msgr2=0x7f0f901f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 0x7f0f901f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 -- 172.21.15.104:0/1677401119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9014ca90 con 0x7f0f78005150 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8effd640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 0x7f0f901f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f8f7fe640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f800066f0 tx=0x7f0f80003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80015070 con 0x7f0f78005150 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f8000fa00 con 0x7f0f78005150 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9014cd70 con 0x7f0f78005150 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000fe50 con 0x7f0f78005150 2024-09-17T04:09:50.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.091+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9014e8d0 con 0x7f0f78005150 2024-09-17T04:09:50.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.092+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f900cf370 con 0x7f0f78005150 2024-09-17T04:09:50.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.093+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f80011430 con 0x7f0f78005150 2024-09-17T04:09:50.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.094+0000 7f0f77fff640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 0x7f0f7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.094+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0f8009bd60 con 0x7f0f78005150 2024-09-17T04:09:50.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.094+0000 7f0f8effd640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 0x7f0f7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.094+0000 7f0f8effd640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 0x7f0f7c07b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f9015c180 tx=0x7f0f8400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.098+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f800638a0 con 0x7f0f78005150 2024-09-17T04:09:50.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.282+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f9015ef30 con 0x7f0f78005150 2024-09-17T04:09:50.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.283+0000 7f0f77fff640 1 -- 172.21.15.104:0/1677401119 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f0f800682d0 con 0x7f0f78005150 2024-09-17T04:09:50.282 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:09:50.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 msgr2=0x7f0f7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 0x7f0f7c07b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f9015c180 tx=0x7f0f8400b260 comp rx=0 tx=0).stop 2024-09-17T04:09:50.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 msgr2=0x7f0f900c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f800066f0 tx=0x7f0f80003a80 comp rx=0 tx=0).stop 2024-09-17T04:09:50.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 shutdown_connections 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f7c078b90 0x7f0f7c07b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f900c6500 0x7f0f901f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f901f2110 0x7f0f901f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 --2- 172.21.15.104:0/1677401119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f78005150 0x7f0f900c5fc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 >> 172.21.15.104:0/1677401119 conn(0x7f0f900b1b90 msgr2=0x7f0f900aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 shutdown_connections 2024-09-17T04:09:50.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.285+0000 7f0f95ba1640 1 -- 172.21.15.104:0/1677401119 wait complete. 2024-09-17T04:09:50.296 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:09:50.296 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:09:50.312 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 -- 172.21.15.104:0/2619787470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe648003a00 msgr2=0x7fe648003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 --2- 172.21.15.104:0/2619787470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe648003a00 0x7fe648003e70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c4a0 tx=0x7fe648005830 comp rx=0 tx=0).stop 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe65ad9d640 1 -- 172.21.15.104:0/2619787470 reap_dead start 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 -- 172.21.15.104:0/2619787470 shutdown_connections 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 -- 172.21.15.104:0/2619787470 >> 172.21.15.104:0/2619787470 conn(0x7fe65c0b46e0 msgr2=0x7fe65c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 -- 172.21.15.104:0/2619787470 shutdown_connections 2024-09-17T04:09:50.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.467+0000 7fe660b0b640 1 -- 172.21.15.104:0/2619787470 wait complete. 2024-09-17T04:09:50.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.469+0000 7fe660b0b640 1 Processor -- start 2024-09-17T04:09:50.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.469+0000 7fe660b0b640 1 -- start start 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe648003a00 0x7fe65c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe65c14add0 0x7fe65c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0b6120 con 0x7fe65c14b510 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0d0960 con 0x7fe648003a00 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe660b0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c0b62a0 con 0x7fe65c14add0 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe651d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe651d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55028/0 (socket says 172.21.15.104:55028) 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe651d9b640 1 -- 172.21.15.104:0/860312963 learned_addr learned my addr 172.21.15.104:0/860312963 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe65a59c640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe648003a00 0x7fe65c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.470+0000 7fe65ad9d640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe65c14add0 0x7fe65c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 -- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe65c14add0 msgr2=0x7fe65c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe65c14add0 0x7fe65c149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 -- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe648003a00 msgr2=0x7fe65c147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe648003a00 0x7fe65c147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 -- 172.21.15.104:0/860312963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c14b1e0 con 0x7fe65c14b510 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe651d9b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe644011ae0 tx=0x7fe644009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64401e070 con 0x7fe65c14b510 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe644004460 con 0x7fe65c14b510 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c1488a0 con 0x7fe65c14b510 2024-09-17T04:09:50.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64400fc40 con 0x7fe65c14b510 2024-09-17T04:09:50.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.471+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c148e60 con 0x7fe65c14b510 2024-09-17T04:09:50.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.472+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c1e3360 con 0x7fe65c14b510 2024-09-17T04:09:50.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.473+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe644021070 con 0x7fe65c14b510 2024-09-17T04:09:50.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.473+0000 7fe6537fe640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 0x7fe63c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.473+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe64409bb90 con 0x7fe65c14b510 2024-09-17T04:09:50.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.474+0000 7fe65a59c640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 0x7fe63c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.474+0000 7fe65a59c640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 0x7fe63c07b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c470 tx=0x7fe64c038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.478+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe65c14b1e0 con 0x7fe65c14b510 2024-09-17T04:09:50.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.663+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe65c0b5be0 con 0x7fe65c14b510 2024-09-17T04:09:50.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.663+0000 7fe6537fe640 1 -- 172.21.15.104:0/860312963 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fe6440635c0 con 0x7fe65c14b510 2024-09-17T04:09:50.663 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:09:50.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 msgr2=0x7fe63c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 0x7fe63c07b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c470 tx=0x7fe64c038040 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 msgr2=0x7fe65c14a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe644011ae0 tx=0x7fe644009e60 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 shutdown_connections 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe63c078bc0 0x7fe63c07b0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe65c14add0 0x7fe65c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe65c14b510 0x7fe65c14a890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 --2- 172.21.15.104:0/860312963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe648003a00 0x7fe65c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 >> 172.21.15.104:0/860312963 conn(0x7fe65c0b46e0 msgr2=0x7fe65c0c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 shutdown_connections 2024-09-17T04:09:50.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.665+0000 7fe660b0b640 1 -- 172.21.15.104:0/860312963 wait complete. 2024-09-17T04:09:50.676 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-09-17T04:09:50.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:50.676 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-17T04:09:50.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi104.stderr:ceph-fuse[43708]: fuse finished with error 0 and tester_r 0 2024-09-17T04:09:50.701 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:09:50.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:09:50.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:09:50.797 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-17T04:09:50.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 -- 172.21.15.104:0/2276025408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae0162280 msgr2=0x7f7ae0162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 --2- 172.21.15.104:0/2276025408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae0162280 0x7f7ae0162690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009830 tx=0x7f7ad402a510 comp rx=0 tx=0).stop 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 -- 172.21.15.104:0/2276025408 shutdown_connections 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 --2- 172.21.15.104:0/2276025408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae0162280 0x7f7ae0162690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 --2- 172.21.15.104:0/2276025408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae0162f00 0x7f7ae00d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 -- 172.21.15.104:0/2276025408 >> 172.21.15.104:0/2276025408 conn(0x7f7ae00b6b20 msgr2=0x7f7ae00d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:50.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 -- 172.21.15.104:0/2276025408 shutdown_connections 2024-09-17T04:09:50.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.975+0000 7f7ae745c640 1 -- 172.21.15.104:0/2276025408 wait complete. 2024-09-17T04:09:50.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.977+0000 7f7ae745c640 1 Processor -- start 2024-09-17T04:09:50.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.977+0000 7f7ae745c640 1 -- start start 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae0162280 0x7f7ae01f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae014d7a0 0x7f7ae01f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae015e630 con 0x7f7ae00b2e40 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae015e4b0 con 0x7f7ae0162280 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae745c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae015e7b0 con 0x7f7ae014d7a0 2024-09-17T04:09:50.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae51f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae51f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55046/0 (socket says 172.21.15.104:55046) 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae51f8640 1 -- 172.21.15.104:0/3010433046 learned_addr learned my addr 172.21.15.104:0/3010433046 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae49f7640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae0162280 0x7f7ae01f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.978+0000 7f7ae59f9640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae014d7a0 0x7f7ae01f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 -- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae014d7a0 msgr2=0x7f7ae01f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae014d7a0 0x7f7ae01f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 -- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae0162280 msgr2=0x7f7ae01f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae0162280 0x7f7ae01f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 -- 172.21.15.104:0/3010433046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae014df10 con 0x7f7ae00b2e40 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae51f8640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000cd10 tx=0x7f7ad000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000f450 con 0x7f7ae00b2e40 2024-09-17T04:09:50.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad000f6e0 con 0x7f7ae00b2e40 2024-09-17T04:09:50.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad000fb10 con 0x7f7ae00b2e40 2024-09-17T04:09:50.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae014e1f0 con 0x7f7ae00b2e40 2024-09-17T04:09:50.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.979+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae00b1840 con 0x7f7ae00b2e40 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.980+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0162f00 con 0x7f7ae00b2e40 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.981+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ad000fcb0 con 0x7f7ae00b2e40 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.981+0000 7f7addffb640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 0x7f7acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.982+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7ad009ba80 con 0x7f7ae00b2e40 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.982+0000 7f7ae49f7640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 0x7f7acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:50.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.982+0000 7f7ae49f7640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 0x7f7acc07b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4034000 tx=0x7f7ad4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:50.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:50.986+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ad0014030 con 0x7f7ae00b2e40 2024-09-17T04:09:51.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.160+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ae00b1630 con 0x7f7ae00b2e40 2024-09-17T04:09:51.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.161+0000 7f7addffb640 1 -- 172.21.15.104:0/3010433046 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7f7ad00635c0 con 0x7f7ae00b2e40 2024-09-17T04:09:51.161 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:51.161 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:51.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 msgr2=0x7f7acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 0x7f7acc07b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4034000 tx=0x7f7ad4004730 comp rx=0 tx=0).stop 2024-09-17T04:09:51.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 msgr2=0x7f7ae00ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000cd10 tx=0x7f7ad000a620 comp rx=0 tx=0).stop 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 shutdown_connections 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7acc078b90 0x7f7acc07b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ae0162280 0x7f7ae01f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ae014d7a0 0x7f7ae01f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 --2- 172.21.15.104:0/3010433046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae00b2e40 0x7f7ae00ad170 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 >> 172.21.15.104:0/3010433046 conn(0x7f7ae00b6b20 msgr2=0x7f7ae006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 shutdown_connections 2024-09-17T04:09:51.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.163+0000 7f7ae745c640 1 -- 172.21.15.104:0/3010433046 wait complete. 2024-09-17T04:09:51.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 -- 172.21.15.104:0/3303987574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc528162280 msgr2=0x7fc528162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 --2- 172.21.15.104:0/3303987574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc528162280 0x7fc528162690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc510005fd0 tx=0x7fc51002a530 comp rx=0 tx=0).stop 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 -- 172.21.15.104:0/3303987574 shutdown_connections 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 --2- 172.21.15.104:0/3303987574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5280b2e40 0x7fc5280b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 --2- 172.21.15.104:0/3303987574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc528162280 0x7fc528162690 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 -- 172.21.15.104:0/3303987574 >> 172.21.15.104:0/3303987574 conn(0x7fc5280b6b20 msgr2=0x7fc5280d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 -- 172.21.15.104:0/3303987574 shutdown_connections 2024-09-17T04:09:51.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.288+0000 7fc52c81d640 1 -- 172.21.15.104:0/3303987574 wait complete. 2024-09-17T04:09:51.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.290+0000 7fc52c81d640 1 Processor -- start 2024-09-17T04:09:51.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.290+0000 7fc52c81d640 1 -- start start 2024-09-17T04:09:51.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 0x7fc5281f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281f8f40 0x7fc5281f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc52815e4b0 con 0x7fc5280b2e40 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc5280b3a20 con 0x7fc5281f8f40 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52c81d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc52815e630 con 0x7fc528162280 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55064/0 (socket says 172.21.15.104:55064) 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.291+0000 7fc52659c640 1 -- 172.21.15.104:0/196320674 learned_addr learned my addr 172.21.15.104:0/196320674 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc51dd9b640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 0x7fc5281f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc526d9d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281f8f40 0x7fc5281f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 -- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 msgr2=0x7fc5281f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 0x7fc5281f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 -- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281f8f40 msgr2=0x7fc5281f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281f8f40 0x7fc5281f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 -- 172.21.15.104:0/196320674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52815bba0 con 0x7fc5280b2e40 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc51dd9b640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 0x7fc5281f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52659c640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc51800b3f0 tx=0x7fc51800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518015020 con 0x7fc5280b2e40 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc518011920 con 0x7fc5280b2e40 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52815c010 con 0x7fc5280b2e40 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518011d70 con 0x7fc5280b2e40 2024-09-17T04:09:51.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.292+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52815c5d0 con 0x7fc5280b2e40 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.293+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc528162f00 con 0x7fc5280b2e40 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.294+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc518018020 con 0x7fc5280b2e40 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.294+0000 7fc51f7fe640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 0x7fc50807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.294+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc51809ad10 con 0x7fc5280b2e40 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.294+0000 7fc51dd9b640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 0x7fc50807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.295+0000 7fc51dd9b640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 0x7fc50807b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc510033000 tx=0x7fc510004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:51.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.299+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc51801f030 con 0x7fc5280b2e40 2024-09-17T04:09:51.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.472+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5281f65d0 con 0x7fc5280b2e40 2024-09-17T04:09:51.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.473+0000 7fc51f7fe640 1 -- 172.21.15.104:0/196320674 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7fc518062e10 con 0x7fc5280b2e40 2024-09-17T04:09:51.473 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:51.474 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.475+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 msgr2=0x7fc50807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.475+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 0x7fc50807b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc510033000 tx=0x7fc510004730 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 msgr2=0x7fc5280b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc51800b3f0 tx=0x7fc51800b8b0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 shutdown_connections 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc508078b90 0x7fc50807b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281f8f40 0x7fc5281f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc528162280 0x7fc5281f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 --2- 172.21.15.104:0/196320674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5280b2e40 0x7fc5280b2120 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 >> 172.21.15.104:0/196320674 conn(0x7fc5280b6b20 msgr2=0x7fc528068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 shutdown_connections 2024-09-17T04:09:51.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.476+0000 7fc52c81d640 1 -- 172.21.15.104:0/196320674 wait complete. 2024-09-17T04:09:51.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T04:09:51.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 -- 172.21.15.104:0/813871943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 msgr2=0x7fed8c0d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 --2- 172.21.15.104:0/813871943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0d0670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fed74005fd0 tx=0x7fed7402a820 comp rx=0 tx=0).stop 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 -- 172.21.15.104:0/813871943 shutdown_connections 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 --2- 172.21.15.104:0/813871943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0d0670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 --2- 172.21.15.104:0/813871943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0ccc40 0x7fed8c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 -- 172.21.15.104:0/813871943 >> 172.21.15.104:0/813871943 conn(0x7fed8c0b46e0 msgr2=0x7fed8c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 -- 172.21.15.104:0/813871943 shutdown_connections 2024-09-17T04:09:51.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.601+0000 7fed92a9b640 1 -- 172.21.15.104:0/813871943 wait complete. 2024-09-17T04:09:51.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.603+0000 7fed92a9b640 1 Processor -- start 2024-09-17T04:09:51.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.603+0000 7fed92a9b640 1 -- start start 2024-09-17T04:09:51.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.604+0000 7fed92a9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 0x7fed8c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 0x7fed8c1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c070810 con 0x7fed8c0cd440 2024-09-17T04:09:51.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c0b6e00 con 0x7fed8c0ccc40 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c070990 con 0x7fed8c0d0bb0 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55082/0 (socket says 172.21.15.104:55082) 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 -- 172.21.15.104:0/314858088 learned_addr learned my addr 172.21.15.104:0/314858088 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed91038640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 0x7fed8c1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed90837640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 0x7fed8c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 -- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 msgr2=0x7fed8c1f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 0x7fed8c1f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 -- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 msgr2=0x7fed8c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 0x7fed8c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:51.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 -- 172.21.15.104:0/314858088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c15a160 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed91038640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 0x7fed8c1f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed90837640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 0x7fed8c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed8bfff640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed7402ae10 tx=0x7fed74032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74037040 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed74042070 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74004280 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8c1585f0 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.605+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8c158bb0 con 0x7fed8c0cd440 2024-09-17T04:09:51.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.606+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed8c070eb0 con 0x7fed8c0cd440 2024-09-17T04:09:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.607+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed74004420 con 0x7fed8c0cd440 2024-09-17T04:09:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.607+0000 7fed897fa640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 0x7fed6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.608+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fed740bbe10 con 0x7fed8c0cd440 2024-09-17T04:09:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.608+0000 7fed90837640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 0x7fed6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.608+0000 7fed90837640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 0x7fed6c07b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009aa0 tx=0x7fed7c005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:51.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.612+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed74084030 con 0x7fed8c0cd440 2024-09-17T04:09:51.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:51.821+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fed8c158380 con 0x7fed8c0cd440 2024-09-17T04:09:52.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.404+0000 7fed897fa640 1 -- 172.21.15.104:0/314858088 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fed74083930 con 0x7fed8c0cd440 2024-09-17T04:09:52.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.406+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 msgr2=0x7fed6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.406+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 0x7fed6c07b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009aa0 tx=0x7fed7c005db0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.406+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 msgr2=0x7fed8c0cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.406+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fed7402ae10 tx=0x7fed74032d10 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 shutdown_connections 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fed6c078bc0 0x7fed6c07b0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed8c0d0bb0 0x7fed8c1f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed8c0cd440 0x7fed8c0cb470 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 --2- 172.21.15.104:0/314858088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed8c0ccc40 0x7fed8c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 >> 172.21.15.104:0/314858088 conn(0x7fed8c0b46e0 msgr2=0x7fed8c0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 shutdown_connections 2024-09-17T04:09:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.407+0000 7fed92a9b640 1 -- 172.21.15.104:0/314858088 wait complete. 2024-09-17T04:09:52.418 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-17T04:09:52.418 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T04:09:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 -- 172.21.15.104:0/3279627044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f598406def0 msgr2=0x7f598406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 --2- 172.21.15.104:0/3279627044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f598406def0 0x7f598406f410 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f597c005fd0 tx=0x7f597c02a530 comp rx=0 tx=0).stop 2024-09-17T04:09:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 -- 172.21.15.104:0/3279627044 shutdown_connections 2024-09-17T04:09:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 --2- 172.21.15.104:0/3279627044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59840b5670 0x7f598415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 --2- 172.21.15.104:0/3279627044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f598406def0 0x7f598406f410 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 -- 172.21.15.104:0/3279627044 >> 172.21.15.104:0/3279627044 conn(0x7f59840cdca0 msgr2=0x7f59840ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 -- 172.21.15.104:0/3279627044 shutdown_connections 2024-09-17T04:09:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.535+0000 7f5988a4d640 1 -- 172.21.15.104:0/3279627044 wait complete. 2024-09-17T04:09:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.537+0000 7f5988a4d640 1 Processor -- start 2024-09-17T04:09:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.537+0000 7f5988a4d640 1 -- start start 2024-09-17T04:09:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598406def0 0x7f59841e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59840b5670 0x7f59840d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f598415ffb0 con 0x7f59840b5260 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f598415fe30 con 0x7f59840b5670 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5984071300 con 0x7f598406def0 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55110/0 (socket says 172.21.15.104:55110) 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 -- 172.21.15.104:0/4282830693 learned_addr learned my addr 172.21.15.104:0/4282830693 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f598259c640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598406def0 0x7f59841e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5982d9d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59840b5670 0x7f59840d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 -- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598406def0 msgr2=0x7f59841e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598406def0 0x7f59841e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 -- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59840b5670 msgr2=0x7f59840d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59840b5670 0x7f59840d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 -- 172.21.15.104:0/4282830693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59841429d0 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5981d9b640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f597400df40 tx=0x7f597400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597400e9e0 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597400eb80 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5984142cb0 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974003970 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.539+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5984143270 con 0x7f59840b5260 2024-09-17T04:09:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.540+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598406f410 con 0x7f59840b5260 2024-09-17T04:09:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.541+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5974009530 con 0x7f59840b5260 2024-09-17T04:09:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.541+0000 7f597affd640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 0x7f596407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.542+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f597409cc30 con 0x7f59840b5260 2024-09-17T04:09:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.542+0000 7f598259c640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 0x7f596407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.542+0000 7f598259c640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 0x7f596407b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.546+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59740646e0 con 0x7f59840b5260 2024-09-17T04:09:52.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:52.756+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f598415cc20 con 0x7f59840b5260 2024-09-17T04:09:53.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.412+0000 7f597affd640 1 -- 172.21.15.104:0/4282830693 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f5974069110 con 0x7f59840b5260 2024-09-17T04:09:53.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 msgr2=0x7f596407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 0x7f596407b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c004730 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 msgr2=0x7f59840b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f597400df40 tx=0x7f597400df70 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 shutdown_connections 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5964078b90 0x7f596407b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59840b5670 0x7f59840d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59840b5260 0x7f59840b26c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.415+0000 7f5988a4d640 1 --2- 172.21.15.104:0/4282830693 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f598406def0 0x7f59841e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.416+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 >> 172.21.15.104:0/4282830693 conn(0x7f59840cdca0 msgr2=0x7f59840d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.416+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 shutdown_connections 2024-09-17T04:09:53.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.416+0000 7f5988a4d640 1 -- 172.21.15.104:0/4282830693 wait complete. 2024-09-17T04:09:53.427 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T04:09:53.428 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:09:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1571561529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a8005150 msgr2=0x7f42a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1571561529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a8005150 0x7f42a800b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009ed0 tx=0x7f42a8005830 comp rx=0 tx=0).stop 2024-09-17T04:09:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42bffff640 1 -- 172.21.15.104:0/1571561529 reap_dead start 2024-09-17T04:09:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1571561529 shutdown_connections 2024-09-17T04:09:53.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1571561529 >> 172.21.15.104:0/1571561529 conn(0x7f42c0072990 msgr2=0x7f42c0072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:53.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1571561529 shutdown_connections 2024-09-17T04:09:53.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.542+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1571561529 wait complete. 2024-09-17T04:09:53.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.544+0000 7f42c5f3a640 1 Processor -- start 2024-09-17T04:09:53.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.544+0000 7f42c5f3a640 1 -- start start 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c0158410 0x7f42c01555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c01f3430 0x7f42c01f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42c015a6f0 con 0x7f42c01f6be0 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42c015a870 con 0x7f42c01f3430 2024-09-17T04:09:53.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42c5f3a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42c015a9f0 con 0x7f42c0158410 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42beffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42beffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55132/0 (socket says 172.21.15.104:55132) 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42beffd640 1 -- 172.21.15.104:0/1532785216 learned_addr learned my addr 172.21.15.104:0/1532785216 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42bffff640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c01f3430 0x7f42c01f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.545+0000 7f42bf7fe640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c0158410 0x7f42c01555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 -- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c0158410 msgr2=0x7f42c01555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c0158410 0x7f42c01555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 -- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c01f3430 msgr2=0x7f42c01f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c01f3430 0x7f42c01f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 -- 172.21.15.104:0/1532785216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c0155af0 con 0x7f42c01f6be0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42beffd640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42b4003f80 tx=0x7f42b40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4016030 con 0x7f42c01f6be0 2024-09-17T04:09:53.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42b4011700 con 0x7f42c01f6be0 2024-09-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c0157370 con 0x7f42c01f6be0 2024-09-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011b30 con 0x7f42c01f6be0 2024-09-17T04:09:53.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.546+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c0157c10 con 0x7f42c01f6be0 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.547+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c015b430 con 0x7f42c01f6be0 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.548+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42b4019070 con 0x7f42c01f6be0 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.548+0000 7f42a7fff640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 0x7f42ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.548+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f42b409b560 con 0x7f42c01f6be0 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.548+0000 7f42bf7fe640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 0x7f42ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.549+0000 7f42bf7fe640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 0x7f42ac07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c9150 tx=0x7f42b00067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:53.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.553+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42c0155af0 con 0x7f42c01f6be0 2024-09-17T04:09:53.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.762+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42c015b150 con 0x7f42c01f6be0 2024-09-17T04:09:53.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.763+0000 7f42a7fff640 1 -- 172.21.15.104:0/1532785216 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f42b4063130 con 0x7f42c01f6be0 2024-09-17T04:09:53.763 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:53.763 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:09:53.763 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 msgr2=0x7f42ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 0x7f42ac07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c9150 tx=0x7f42b00067a0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 msgr2=0x7f42c01f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42b4003f80 tx=0x7f42b40016f0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 shutdown_connections 2024-09-17T04:09:53.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f42ac078b90 0x7f42ac07b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c01f3430 0x7f42c01f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c01f6be0 0x7f42c01f6ff0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 --2- 172.21.15.104:0/1532785216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c0158410 0x7f42c01555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 >> 172.21.15.104:0/1532785216 conn(0x7f42c0072990 msgr2=0x7f42c015d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 shutdown_connections 2024-09-17T04:09:53.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.765+0000 7f42c5f3a640 1 -- 172.21.15.104:0/1532785216 wait complete. 2024-09-17T04:09:53.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 -- 172.21.15.104:0/1863109703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb000d1d00 msgr2=0x7ffb000cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 --2- 172.21.15.104:0/1863109703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb000d1d00 0x7ffb000cc930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4005fd0 tx=0x7ffaf402a5c0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 -- 172.21.15.104:0/1863109703 shutdown_connections 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 --2- 172.21.15.104:0/1863109703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb000d1d00 0x7ffb000cc930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 --2- 172.21.15.104:0/1863109703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb001536e0 0x7ffb000d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.887+0000 7ffb062cc640 1 -- 172.21.15.104:0/1863109703 >> 172.21.15.104:0/1863109703 conn(0x7ffb000cef40 msgr2=0x7ffb000cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.888+0000 7ffb062cc640 1 -- 172.21.15.104:0/1863109703 shutdown_connections 2024-09-17T04:09:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.888+0000 7ffb062cc640 1 -- 172.21.15.104:0/1863109703 wait complete. 2024-09-17T04:09:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.889+0000 7ffb062cc640 1 Processor -- start 2024-09-17T04:09:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.889+0000 7ffb062cc640 1 -- start start 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 0x7ffb001f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 0x7ffb000b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001608a0 con 0x7ffb000cce70 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00160a20 con 0x7ffb001536e0 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb062cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ffb00160ba0 con 0x7ffb000d1d00 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55142/0 (socket says 172.21.15.104:55142) 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 -- 172.21.15.104:0/4099110396 learned_addr learned my addr 172.21.15.104:0/4099110396 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffaff7fe640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 0x7ffb001f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb04869640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 0x7ffb000b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 -- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 msgr2=0x7ffb001f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 0x7ffb001f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 -- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 msgr2=0x7ffb000b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 0x7ffb000b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 -- 172.21.15.104:0/4099110396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb000b8140 con 0x7ffb000cce70 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffaff7fe640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 0x7ffb001f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffb04869640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 0x7ffb000b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafffff640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e790 tx=0x7ffaf000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.891+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000eea0 con 0x7ffb000cce70 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.892+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffaf000cdb0 con 0x7ffb000cce70 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.892+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb001e5ec0 con 0x7ffb000cce70 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.892+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0010690 con 0x7ffb000cce70 2024-09-17T04:09:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.892+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb001e6480 con 0x7ffb000cce70 2024-09-17T04:09:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.893+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb000cc930 con 0x7ffb000cce70 2024-09-17T04:09:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.893+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffaf0010830 con 0x7ffb000cce70 2024-09-17T04:09:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.894+0000 7ffafcff9640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 0x7ffaec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:53.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.894+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffaf009bae0 con 0x7ffb000cce70 2024-09-17T04:09:53.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.894+0000 7ffaff7fe640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 0x7ffaec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:53.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.895+0000 7ffaff7fe640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 0x7ffaec07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4033000 tx=0x7ffaf4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:53.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:53.899+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffaf0063bd0 con 0x7ffb000cce70 2024-09-17T04:09:54.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.075+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb0015f870 con 0x7ffb000cce70 2024-09-17T04:09:54.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.076+0000 7ffafcff9640 1 -- 172.21.15.104:0/4099110396 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7ffaf00634d0 con 0x7ffb000cce70 2024-09-17T04:09:54.076 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:54.076 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 msgr2=0x7ffaec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 0x7ffaec07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4033000 tx=0x7ffaf4004730 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 msgr2=0x7ffb000b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e790 tx=0x7ffaf000ec50 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 shutdown_connections 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ffaec078b90 0x7ffaec07b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb001536e0 0x7ffb000b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb000d1d00 0x7ffb001f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.078+0000 7ffb062cc640 1 --2- 172.21.15.104:0/4099110396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb000cce70 0x7ffb000b79a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.079+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 >> 172.21.15.104:0/4099110396 conn(0x7ffb000cef40 msgr2=0x7ffb000d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.079+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 shutdown_connections 2024-09-17T04:09:54.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.079+0000 7ffb062cc640 1 -- 172.21.15.104:0/4099110396 wait complete. 2024-09-17T04:09:54.090 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:09:54.090 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 -- 172.21.15.104:0/2046067759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d0980 msgr2=0x7fb20c0d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 --2- 172.21.15.104:0/2046067759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d0980 0x7fb20c0d0d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb204005fd0 tx=0x7fb20402a8b0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 -- 172.21.15.104:0/2046067759 shutdown_connections 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 --2- 172.21.15.104:0/2046067759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d0980 0x7fb20c0d0d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 --2- 172.21.15.104:0/2046067759 >> v2:172.21.15.192:3300/0 conn(0x7fb20c15daf0 0x7fb20c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 -- 172.21.15.104:0/2046067759 >> 172.21.15.104:0/2046067759 conn(0x7fb20c072990 msgr2=0x7fb20c072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 -- 172.21.15.104:0/2046067759 shutdown_connections 2024-09-17T04:09:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.202+0000 7fb213a69640 1 -- 172.21.15.104:0/2046067759 wait complete. 2024-09-17T04:09:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.204+0000 7fb213a69640 1 Processor -- start 2024-09-17T04:09:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.204+0000 7fb213a69640 1 -- start start 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d01f0 0x7fb20c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb20c0d0980 0x7fb20c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c0cd340 con 0x7fb20c15daf0 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c0cd1c0 con 0x7fb20c0d0980 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb213a69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb20c0cd4c0 con 0x7fb20c0d01f0 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55158/0 (socket says 172.21.15.104:55158) 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 -- 172.21.15.104:0/1537622728 learned_addr learned my addr 172.21.15.104:0/1537622728 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb211004640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb20c0d0980 0x7fb20c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb211805640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d01f0 0x7fb20c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 -- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d01f0 msgr2=0x7fb20c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d01f0 0x7fb20c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 -- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb20c0d0980 msgr2=0x7fb20c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb20c0d0980 0x7fb20c0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.205+0000 7fb212006640 1 -- 172.21.15.104:0/1537622728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c0c5f70 con 0x7fb20c15daf0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb212006640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb20402aea0 tx=0x7fb2040316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204031da0 con 0x7fb20c15daf0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb204003a60 con 0x7fb20c15daf0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040330d0 con 0x7fb20c15daf0 2024-09-17T04:09:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c0c6250 con 0x7fb20c15daf0 2024-09-17T04:09:54.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.206+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c0c6810 con 0x7fb20c15daf0 2024-09-17T04:09:54.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.207+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c0cd970 con 0x7fb20c15daf0 2024-09-17T04:09:54.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.208+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb204033270 con 0x7fb20c15daf0 2024-09-17T04:09:54.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.208+0000 7fb2027fc640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.208+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb2040bc730 con 0x7fb20c15daf0 2024-09-17T04:09:54.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.208+0000 7fb211805640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.209+0000 7fb211805640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 0x7fb1f007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2080013f0 tx=0x7fb208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.212+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb20403f030 con 0x7fb20c15daf0 2024-09-17T04:09:54.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.385+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb20c076230 con 0x7fb1f0078b90 2024-09-17T04:09:54.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.392+0000 7fb2027fc640 1 -- 172.21.15.104:0/1537622728 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332619 (secure 0 0 0) 0x7fb20c076230 con 0x7fb1f0078b90 2024-09-17T04:09:54.395 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:54.397 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 msgr2=0x7fb1f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 0x7fb1f007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2080013f0 tx=0x7fb208009040 comp rx=0 tx=0).stop 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 msgr2=0x7fb20c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb20402aea0 tx=0x7fb2040316f0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 shutdown_connections 2024-09-17T04:09:54.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb20c0d0980 0x7fb20c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb20c15daf0 0x7fb20c0cb270 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 --2- 172.21.15.104:0/1537622728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb20c0d01f0 0x7fb20c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 >> 172.21.15.104:0/1537622728 conn(0x7fb20c072990 msgr2=0x7fb20c159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 shutdown_connections 2024-09-17T04:09:54.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.395+0000 7fb213a69640 1 -- 172.21.15.104:0/1537622728 wait complete. 2024-09-17T04:09:54.406 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T04:09:53.346207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2076396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.982377"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488204+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:09:45.488204+0000","last_peered":"2024-09-17T04:09:45.488204+0000","last_clean":"2024-09-17T04:09:45.488204+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:09:45.488204+0000","last_undegraded":"2024-09-17T04:09:45.488204+0000","last_fullsized":"2024-09-17T04:09:45.488204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487142+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:09:45.487142+0000","last_peered":"2024-09-17T04:09:45.487142+0000","last_clean":"2024-09-17T04:09:45.487142+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:09:45.487142+0000","last_undegraded":"2024-09-17T04:09:45.487142+0000","last_fullsized":"2024-09-17T04:09:45.487142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488102+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:09:45.488102+0000","last_peered":"2024-09-17T04:09:45.488102+0000","last_clean":"2024-09-17T04:09:45.488102+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:09:45.488102+0000","last_undegraded":"2024-09-17T04:09:45.488102+0000","last_fullsized":"2024-09-17T04:09:45.488102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487419+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:09:45.487419+0000","last_peered":"2024-09-17T04:09:45.487419+0000","last_clean":"2024-09-17T04:09:45.487419+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:09:45.487419+0000","last_undegraded":"2024-09-17T04:09:45.487419+0000","last_fullsized":"2024-09-17T04:09:45.487419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487870+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:09:45.487870+0000","last_peered":"2024-09-17T04:09:45.487870+0000","last_clean":"2024-09-17T04:09:45.487870+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:09:45.487870+0000","last_undegraded":"2024-09-17T04:09:45.487870+0000","last_fullsized":"2024-09-17T04:09:45.487870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381185+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:09:45.381185+0000","last_peered":"2024-09-17T04:09:45.381185+0000","last_clean":"2024-09-17T04:09:45.381185+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:09:45.381185+0000","last_undegraded":"2024-09-17T04:09:45.381185+0000","last_fullsized":"2024-09-17T04:09:45.381185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488189+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:09:45.488189+0000","last_peered":"2024-09-17T04:09:45.488189+0000","last_clean":"2024-09-17T04:09:45.488189+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:09:45.488189+0000","last_undegraded":"2024-09-17T04:09:45.488189+0000","last_fullsized":"2024-09-17T04:09:45.488189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488154+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:09:45.488154+0000","last_peered":"2024-09-17T04:09:45.488154+0000","last_clean":"2024-09-17T04:09:45.488154+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:09:45.488154+0000","last_undegraded":"2024-09-17T04:09:45.488154+0000","last_fullsized":"2024-09-17T04:09:45.488154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380765+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:09:45.380765+0000","last_peered":"2024-09-17T04:09:45.380765+0000","last_clean":"2024-09-17T04:09:45.380765+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:09:45.380765+0000","last_undegraded":"2024-09-17T04:09:45.380765+0000","last_fullsized":"2024-09-17T04:09:45.380765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488356+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:09:45.488356+0000","last_peered":"2024-09-17T04:09:45.488356+0000","last_clean":"2024-09-17T04:09:45.488356+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:09:45.488356+0000","last_undegraded":"2024-09-17T04:09:45.488356+0000","last_fullsized":"2024-09-17T04:09:45.488356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380259+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:09:45.380259+0000","last_peered":"2024-09-17T04:09:45.380259+0000","last_clean":"2024-09-17T04:09:45.380259+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:09:45.380259+0000","last_undegraded":"2024-09-17T04:09:45.380259+0000","last_fullsized":"2024-09-17T04:09:45.380259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380346+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:09:45.380346+0000","last_peered":"2024-09-17T04:09:45.380346+0000","last_clean":"2024-09-17T04:09:45.380346+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:09:45.380346+0000","last_undegraded":"2024-09-17T04:09:45.380346+0000","last_fullsized":"2024-09-17T04:09:45.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487865+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:09:45.487865+0000","last_peered":"2024-09-17T04:09:45.487865+0000","last_clean":"2024-09-17T04:09:45.487865+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:09:45.487865+0000","last_undegraded":"2024-09-17T04:09:45.487865+0000","last_fullsized":"2024-09-17T04:09:45.487865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379933+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:09:45.379933+0000","last_peered":"2024-09-17T04:09:45.379933+0000","last_clean":"2024-09-17T04:09:45.379933+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:09:45.379933+0000","last_undegraded":"2024-09-17T04:09:45.379933+0000","last_fullsized":"2024-09-17T04:09:45.379933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487666+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:09:45.487666+0000","last_peered":"2024-09-17T04:09:45.487666+0000","last_clean":"2024-09-17T04:09:45.487666+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:09:45.487666+0000","last_undegraded":"2024-09-17T04:09:45.487666+0000","last_fullsized":"2024-09-17T04:09:45.487666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489005+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:09:45.489005+0000","last_peered":"2024-09-17T04:09:45.489005+0000","last_clean":"2024-09-17T04:09:45.489005+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:09:45.489005+0000","last_undegraded":"2024-09-17T04:09:45.489005+0000","last_fullsized":"2024-09-17T04:09:45.489005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381675+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:09:45.381675+0000","last_peered":"2024-09-17T04:09:45.381675+0000","last_clean":"2024-09-17T04:09:45.381675+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:09:45.381675+0000","last_undegraded":"2024-09-17T04:09:45.381675+0000","last_fullsized":"2024-09-17T04:09:45.381675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489776+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:09:45.489776+0000","last_peered":"2024-09-17T04:09:45.489776+0000","last_clean":"2024-09-17T04:09:45.489776+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:09:45.489776+0000","last_undegraded":"2024-09-17T04:09:45.489776+0000","last_fullsized":"2024-09-17T04:09:45.489776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487117+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:09:45.487117+0000","last_peered":"2024-09-17T04:09:45.487117+0000","last_clean":"2024-09-17T04:09:45.487117+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:09:45.487117+0000","last_undegraded":"2024-09-17T04:09:45.487117+0000","last_fullsized":"2024-09-17T04:09:45.487117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489018+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:09:45.489018+0000","last_peered":"2024-09-17T04:09:45.489018+0000","last_clean":"2024-09-17T04:09:45.489018+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:09:45.489018+0000","last_undegraded":"2024-09-17T04:09:45.489018+0000","last_fullsized":"2024-09-17T04:09:45.489018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.382031+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:09:45.382031+0000","last_peered":"2024-09-17T04:09:45.382031+0000","last_clean":"2024-09-17T04:09:45.382031+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:09:45.382031+0000","last_undegraded":"2024-09-17T04:09:45.382031+0000","last_fullsized":"2024-09-17T04:09:45.382031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486989+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:09:45.486989+0000","last_peered":"2024-09-17T04:09:45.486989+0000","last_clean":"2024-09-17T04:09:45.486989+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:09:45.486989+0000","last_undegraded":"2024-09-17T04:09:45.486989+0000","last_fullsized":"2024-09-17T04:09:45.486989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379739+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:09:45.379739+0000","last_peered":"2024-09-17T04:09:45.379739+0000","last_clean":"2024-09-17T04:09:45.379739+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:09:45.379739+0000","last_undegraded":"2024-09-17T04:09:45.379739+0000","last_fullsized":"2024-09-17T04:09:45.379739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488557+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:09:45.488557+0000","last_peered":"2024-09-17T04:09:45.488557+0000","last_clean":"2024-09-17T04:09:45.488557+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:09:45.488557+0000","last_undegraded":"2024-09-17T04:09:45.488557+0000","last_fullsized":"2024-09-17T04:09:45.488557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381554+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:09:45.381554+0000","last_peered":"2024-09-17T04:09:45.381554+0000","last_clean":"2024-09-17T04:09:45.381554+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:09:45.381554+0000","last_undegraded":"2024-09-17T04:09:45.381554+0000","last_fullsized":"2024-09-17T04:09:45.381554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381830+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:09:45.381830+0000","last_peered":"2024-09-17T04:09:45.381830+0000","last_clean":"2024-09-17T04:09:45.381830+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:09:45.381830+0000","last_undegraded":"2024-09-17T04:09:45.381830+0000","last_fullsized":"2024-09-17T04:09:45.381830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488750+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:09:45.488750+0000","last_peered":"2024-09-17T04:09:45.488750+0000","last_clean":"2024-09-17T04:09:45.488750+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:09:45.488750+0000","last_undegraded":"2024-09-17T04:09:45.488750+0000","last_fullsized":"2024-09-17T04:09:45.488750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489146+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:09:45.489146+0000","last_peered":"2024-09-17T04:09:45.489146+0000","last_clean":"2024-09-17T04:09:45.489146+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:09:45.489146+0000","last_undegraded":"2024-09-17T04:09:45.489146+0000","last_fullsized":"2024-09-17T04:09:45.489146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489258+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:09:45.489258+0000","last_peered":"2024-09-17T04:09:45.489258+0000","last_clean":"2024-09-17T04:09:45.489258+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:09:45.489258+0000","last_undegraded":"2024-09-17T04:09:45.489258+0000","last_fullsized":"2024-09-17T04:09:45.489258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489441+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:09:45.489441+0000","last_peered":"2024-09-17T04:09:45.489441+0000","last_clean":"2024-09-17T04:09:45.489441+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:09:45.489441+0000","last_undegraded":"2024-09-17T04:09:45.489441+0000","last_fullsized":"2024-09-17T04:09:45.489441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488314+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:09:45.488314+0000","last_peered":"2024-09-17T04:09:45.488314+0000","last_clean":"2024-09-17T04:09:45.488314+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:09:45.488314+0000","last_undegraded":"2024-09-17T04:09:45.488314+0000","last_fullsized":"2024-09-17T04:09:45.488314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487080+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:09:45.487080+0000","last_peered":"2024-09-17T04:09:45.487080+0000","last_clean":"2024-09-17T04:09:45.487080+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:09:45.487080+0000","last_undegraded":"2024-09-17T04:09:45.487080+0000","last_fullsized":"2024-09-17T04:09:45.487080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488377+0000","last_change":"2024-09-17T04:09:40.352259+0000","last_active":"2024-09-17T04:09:45.488377+0000","last_peered":"2024-09-17T04:09:45.488377+0000","last_clean":"2024-09-17T04:09:45.488377+0000","last_became_active":"2024-09-17T04:09:40.351940+0000","last_became_peered":"2024-09-17T04:09:40.351940+0000","last_unstale":"2024-09-17T04:09:45.488377+0000","last_undegraded":"2024-09-17T04:09:45.488377+0000","last_fullsized":"2024-09-17T04:09:45.488377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489543+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:09:45.489543+0000","last_peered":"2024-09-17T04:09:45.489543+0000","last_clean":"2024-09-17T04:09:45.489543+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:09:45.489543+0000","last_undegraded":"2024-09-17T04:09:45.489543+0000","last_fullsized":"2024-09-17T04:09:45.489543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488788+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:09:45.488788+0000","last_peered":"2024-09-17T04:09:45.488788+0000","last_clean":"2024-09-17T04:09:45.488788+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:09:45.488788+0000","last_undegraded":"2024-09-17T04:09:45.488788+0000","last_fullsized":"2024-09-17T04:09:45.488788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381892+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:09:45.381892+0000","last_peered":"2024-09-17T04:09:45.381892+0000","last_clean":"2024-09-17T04:09:45.381892+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:09:45.381892+0000","last_undegraded":"2024-09-17T04:09:45.381892+0000","last_fullsized":"2024-09-17T04:09:45.381892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488433+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:09:45.488433+0000","last_peered":"2024-09-17T04:09:45.488433+0000","last_clean":"2024-09-17T04:09:45.488433+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:09:45.488433+0000","last_undegraded":"2024-09-17T04:09:45.488433+0000","last_fullsized":"2024-09-17T04:09:45.488433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489278+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:09:45.489278+0000","last_peered":"2024-09-17T04:09:45.489278+0000","last_clean":"2024-09-17T04:09:45.489278+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:09:45.489278+0000","last_undegraded":"2024-09-17T04:09:45.489278+0000","last_fullsized":"2024-09-17T04:09:45.489278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487967+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:09:45.487967+0000","last_peered":"2024-09-17T04:09:45.487967+0000","last_clean":"2024-09-17T04:09:45.487967+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:09:45.487967+0000","last_undegraded":"2024-09-17T04:09:45.487967+0000","last_fullsized":"2024-09-17T04:09:45.487967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376260+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:09:45.376260+0000","last_peered":"2024-09-17T04:09:45.376260+0000","last_clean":"2024-09-17T04:09:45.376260+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:09:45.376260+0000","last_undegraded":"2024-09-17T04:09:45.376260+0000","last_fullsized":"2024-09-17T04:09:45.376260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488812+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:09:45.488812+0000","last_peered":"2024-09-17T04:09:45.488812+0000","last_clean":"2024-09-17T04:09:45.488812+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:09:45.488812+0000","last_undegraded":"2024-09-17T04:09:45.488812+0000","last_fullsized":"2024-09-17T04:09:45.488812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486751+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:09:45.486751+0000","last_peered":"2024-09-17T04:09:45.486751+0000","last_clean":"2024-09-17T04:09:45.486751+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:09:45.486751+0000","last_undegraded":"2024-09-17T04:09:45.486751+0000","last_fullsized":"2024-09-17T04:09:45.486751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486996+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:09:45.486996+0000","last_peered":"2024-09-17T04:09:45.486996+0000","last_clean":"2024-09-17T04:09:45.486996+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:09:45.486996+0000","last_undegraded":"2024-09-17T04:09:45.486996+0000","last_fullsized":"2024-09-17T04:09:45.486996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488479+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:09:45.488479+0000","last_peered":"2024-09-17T04:09:45.488479+0000","last_clean":"2024-09-17T04:09:45.488479+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:09:45.488479+0000","last_undegraded":"2024-09-17T04:09:45.488479+0000","last_fullsized":"2024-09-17T04:09:45.488479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487202+0000","last_change":"2024-09-17T04:09:40.352550+0000","last_active":"2024-09-17T04:09:45.487202+0000","last_peered":"2024-09-17T04:09:45.487202+0000","last_clean":"2024-09-17T04:09:45.487202+0000","last_became_active":"2024-09-17T04:09:40.352245+0000","last_became_peered":"2024-09-17T04:09:40.352245+0000","last_unstale":"2024-09-17T04:09:45.487202+0000","last_undegraded":"2024-09-17T04:09:45.487202+0000","last_fullsized":"2024-09-17T04:09:45.487202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:30.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487781+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:09:45.487781+0000","last_peered":"2024-09-17T04:09:45.487781+0000","last_clean":"2024-09-17T04:09:45.487781+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:09:45.487781+0000","last_undegraded":"2024-09-17T04:09:45.487781+0000","last_fullsized":"2024-09-17T04:09:45.487781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487130+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:09:45.487130+0000","last_peered":"2024-09-17T04:09:45.487130+0000","last_clean":"2024-09-17T04:09:45.487130+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:09:45.487130+0000","last_undegraded":"2024-09-17T04:09:45.487130+0000","last_fullsized":"2024-09-17T04:09:45.487130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380658+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:09:45.380658+0000","last_peered":"2024-09-17T04:09:45.380658+0000","last_clean":"2024-09-17T04:09:45.380658+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:09:45.380658+0000","last_undegraded":"2024-09-17T04:09:45.380658+0000","last_fullsized":"2024-09-17T04:09:45.380658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487996+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:09:45.487996+0000","last_peered":"2024-09-17T04:09:45.487996+0000","last_clean":"2024-09-17T04:09:45.487996+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:09:45.487996+0000","last_undegraded":"2024-09-17T04:09:45.487996+0000","last_fullsized":"2024-09-17T04:09:45.487996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376608+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:09:45.376608+0000","last_peered":"2024-09-17T04:09:45.376608+0000","last_clean":"2024-09-17T04:09:45.376608+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:09:45.376608+0000","last_undegraded":"2024-09-17T04:09:45.376608+0000","last_fullsized":"2024-09-17T04:09:45.376608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379735+0000","last_change":"2024-09-17T04:09:44.490924+0000","last_active":"2024-09-17T04:09:45.379735+0000","last_peered":"2024-09-17T04:09:45.379735+0000","last_clean":"2024-09-17T04:09:45.379735+0000","last_became_active":"2024-09-17T04:09:44.490464+0000","last_became_peered":"2024-09-17T04:09:44.490464+0000","last_unstale":"2024-09-17T04:09:45.379735+0000","last_undegraded":"2024-09-17T04:09:45.379735+0000","last_fullsized":"2024-09-17T04:09:45.379735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:07.828382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488305+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:09:45.488305+0000","last_peered":"2024-09-17T04:09:45.488305+0000","last_clean":"2024-09-17T04:09:45.488305+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:09:45.488305+0000","last_undegraded":"2024-09-17T04:09:45.488305+0000","last_fullsized":"2024-09-17T04:09:45.488305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488284+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:09:45.488284+0000","last_peered":"2024-09-17T04:09:45.488284+0000","last_clean":"2024-09-17T04:09:45.488284+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:09:45.488284+0000","last_undegraded":"2024-09-17T04:09:45.488284+0000","last_fullsized":"2024-09-17T04:09:45.488284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487424+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:09:45.487424+0000","last_peered":"2024-09-17T04:09:45.487424+0000","last_clean":"2024-09-17T04:09:45.487424+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:09:45.487424+0000","last_undegraded":"2024-09-17T04:09:45.487424+0000","last_fullsized":"2024-09-17T04:09:45.487424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488308+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:09:45.488308+0000","last_peered":"2024-09-17T04:09:45.488308+0000","last_clean":"2024-09-17T04:09:45.488308+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:09:45.488308+0000","last_undegraded":"2024-09-17T04:09:45.488308+0000","last_fullsized":"2024-09-17T04:09:45.488308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376681+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:09:45.376681+0000","last_peered":"2024-09-17T04:09:45.376681+0000","last_clean":"2024-09-17T04:09:45.376681+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:09:45.376681+0000","last_undegraded":"2024-09-17T04:09:45.376681+0000","last_fullsized":"2024-09-17T04:09:45.376681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486994+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:09:45.486994+0000","last_peered":"2024-09-17T04:09:45.486994+0000","last_clean":"2024-09-17T04:09:45.486994+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:09:45.486994+0000","last_undegraded":"2024-09-17T04:09:45.486994+0000","last_fullsized":"2024-09-17T04:09:45.486994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488529+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:09:45.488529+0000","last_peered":"2024-09-17T04:09:45.488529+0000","last_clean":"2024-09-17T04:09:45.488529+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:09:45.488529+0000","last_undegraded":"2024-09-17T04:09:45.488529+0000","last_fullsized":"2024-09-17T04:09:45.488529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381107+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:09:45.381107+0000","last_peered":"2024-09-17T04:09:45.381107+0000","last_clean":"2024-09-17T04:09:45.381107+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:09:45.381107+0000","last_undegraded":"2024-09-17T04:09:45.381107+0000","last_fullsized":"2024-09-17T04:09:45.381107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380901+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:09:45.380901+0000","last_peered":"2024-09-17T04:09:45.380901+0000","last_clean":"2024-09-17T04:09:45.380901+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:09:45.380901+0000","last_undegraded":"2024-09-17T04:09:45.380901+0000","last_fullsized":"2024-09-17T04:09:45.380901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487226+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:09:45.487226+0000","last_peered":"2024-09-17T04:09:45.487226+0000","last_clean":"2024-09-17T04:09:45.487226+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:09:45.487226+0000","last_undegraded":"2024-09-17T04:09:45.487226+0000","last_fullsized":"2024-09-17T04:09:45.487226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376124+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:09:45.376124+0000","last_peered":"2024-09-17T04:09:45.376124+0000","last_clean":"2024-09-17T04:09:45.376124+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:09:45.376124+0000","last_undegraded":"2024-09-17T04:09:45.376124+0000","last_fullsized":"2024-09-17T04:09:45.376124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488264+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:09:45.488264+0000","last_peered":"2024-09-17T04:09:45.488264+0000","last_clean":"2024-09-17T04:09:45.488264+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:09:45.488264+0000","last_undegraded":"2024-09-17T04:09:45.488264+0000","last_fullsized":"2024-09-17T04:09:45.488264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379655+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:09:45.379655+0000","last_peered":"2024-09-17T04:09:45.379655+0000","last_clean":"2024-09-17T04:09:45.379655+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:09:45.379655+0000","last_undegraded":"2024-09-17T04:09:45.379655+0000","last_fullsized":"2024-09-17T04:09:45.379655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379962+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:09:45.379962+0000","last_peered":"2024-09-17T04:09:45.379962+0000","last_clean":"2024-09-17T04:09:45.379962+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:09:45.379962+0000","last_undegraded":"2024-09-17T04:09:45.379962+0000","last_fullsized":"2024-09-17T04:09:45.379962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488461+0000","last_change":"2024-09-17T04:09:44.494839+0000","last_active":"2024-09-17T04:09:45.488461+0000","last_peered":"2024-09-17T04:09:45.488461+0000","last_clean":"2024-09-17T04:09:45.488461+0000","last_became_active":"2024-09-17T04:09:44.494396+0000","last_became_peered":"2024-09-17T04:09:44.494396+0000","last_unstale":"2024-09-17T04:09:45.488461+0000","last_undegraded":"2024-09-17T04:09:45.488461+0000","last_fullsized":"2024-09-17T04:09:45.488461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:45.786583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487743+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:09:45.487743+0000","last_peered":"2024-09-17T04:09:45.487743+0000","last_clean":"2024-09-17T04:09:45.487743+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:09:45.487743+0000","last_undegraded":"2024-09-17T04:09:45.487743+0000","last_fullsized":"2024-09-17T04:09:45.487743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488322+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:09:45.488322+0000","last_peered":"2024-09-17T04:09:45.488322+0000","last_clean":"2024-09-17T04:09:45.488322+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:09:45.488322+0000","last_undegraded":"2024-09-17T04:09:45.488322+0000","last_fullsized":"2024-09-17T04:09:45.488322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489197+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:09:45.489197+0000","last_peered":"2024-09-17T04:09:45.489197+0000","last_clean":"2024-09-17T04:09:45.489197+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:09:45.489197+0000","last_undegraded":"2024-09-17T04:09:45.489197+0000","last_fullsized":"2024-09-17T04:09:45.489197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487785+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:09:45.487785+0000","last_peered":"2024-09-17T04:09:45.487785+0000","last_clean":"2024-09-17T04:09:45.487785+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:09:45.487785+0000","last_undegraded":"2024-09-17T04:09:45.487785+0000","last_fullsized":"2024-09-17T04:09:45.487785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488190+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:09:45.488190+0000","last_peered":"2024-09-17T04:09:45.488190+0000","last_clean":"2024-09-17T04:09:45.488190+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:09:45.488190+0000","last_undegraded":"2024-09-17T04:09:45.488190+0000","last_fullsized":"2024-09-17T04:09:45.488190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487532+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:09:45.487532+0000","last_peered":"2024-09-17T04:09:45.487532+0000","last_clean":"2024-09-17T04:09:45.487532+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:09:45.487532+0000","last_undegraded":"2024-09-17T04:09:45.487532+0000","last_fullsized":"2024-09-17T04:09:45.487532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380427+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:09:45.380427+0000","last_peered":"2024-09-17T04:09:45.380427+0000","last_clean":"2024-09-17T04:09:45.380427+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:09:45.380427+0000","last_undegraded":"2024-09-17T04:09:45.380427+0000","last_fullsized":"2024-09-17T04:09:45.380427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488917+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:09:45.488917+0000","last_peered":"2024-09-17T04:09:45.488917+0000","last_clean":"2024-09-17T04:09:45.488917+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:09:45.488917+0000","last_undegraded":"2024-09-17T04:09:45.488917+0000","last_fullsized":"2024-09-17T04:09:45.488917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381857+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:09:45.381857+0000","last_peered":"2024-09-17T04:09:45.381857+0000","last_clean":"2024-09-17T04:09:45.381857+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:09:45.381857+0000","last_undegraded":"2024-09-17T04:09:45.381857+0000","last_fullsized":"2024-09-17T04:09:45.381857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488252+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:09:45.488252+0000","last_peered":"2024-09-17T04:09:45.488252+0000","last_clean":"2024-09-17T04:09:45.488252+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:09:45.488252+0000","last_undegraded":"2024-09-17T04:09:45.488252+0000","last_fullsized":"2024-09-17T04:09:45.488252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381469+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:09:45.381469+0000","last_peered":"2024-09-17T04:09:45.381469+0000","last_clean":"2024-09-17T04:09:45.381469+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:09:45.381469+0000","last_undegraded":"2024-09-17T04:09:45.381469+0000","last_fullsized":"2024-09-17T04:09:45.381469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488076+0000","last_change":"2024-09-17T04:09:40.340531+0000","last_active":"2024-09-17T04:09:45.488076+0000","last_peered":"2024-09-17T04:09:45.488076+0000","last_clean":"2024-09-17T04:09:45.488076+0000","last_became_active":"2024-09-17T04:09:40.340218+0000","last_became_peered":"2024-09-17T04:09:40.340218+0000","last_unstale":"2024-09-17T04:09:45.488076+0000","last_undegraded":"2024-09-17T04:09:45.488076+0000","last_fullsized":"2024-09-17T04:09:45.488076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488153+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:09:45.488153+0000","last_peered":"2024-09-17T04:09:45.488153+0000","last_clean":"2024-09-17T04:09:45.488153+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:09:45.488153+0000","last_undegraded":"2024-09-17T04:09:45.488153+0000","last_fullsized":"2024-09-17T04:09:45.488153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489688+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:09:45.489688+0000","last_peered":"2024-09-17T04:09:45.489688+0000","last_clean":"2024-09-17T04:09:45.489688+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:09:45.489688+0000","last_undegraded":"2024-09-17T04:09:45.489688+0000","last_fullsized":"2024-09-17T04:09:45.489688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488106+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:09:45.488106+0000","last_peered":"2024-09-17T04:09:45.488106+0000","last_clean":"2024-09-17T04:09:45.488106+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:09:45.488106+0000","last_undegraded":"2024-09-17T04:09:45.488106+0000","last_fullsized":"2024-09-17T04:09:45.488106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381382+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:09:45.381382+0000","last_peered":"2024-09-17T04:09:45.381382+0000","last_clean":"2024-09-17T04:09:45.381382+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:09:45.381382+0000","last_undegraded":"2024-09-17T04:09:45.381382+0000","last_fullsized":"2024-09-17T04:09:45.381382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488352+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:09:45.488352+0000","last_peered":"2024-09-17T04:09:45.488352+0000","last_clean":"2024-09-17T04:09:45.488352+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:09:45.488352+0000","last_undegraded":"2024-09-17T04:09:45.488352+0000","last_fullsized":"2024-09-17T04:09:45.488352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488015+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:09:45.488015+0000","last_peered":"2024-09-17T04:09:45.488015+0000","last_clean":"2024-09-17T04:09:45.488015+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:09:45.488015+0000","last_undegraded":"2024-09-17T04:09:45.488015+0000","last_fullsized":"2024-09-17T04:09:45.488015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486906+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:09:45.486906+0000","last_peered":"2024-09-17T04:09:45.486906+0000","last_clean":"2024-09-17T04:09:45.486906+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:09:45.486906+0000","last_undegraded":"2024-09-17T04:09:45.486906+0000","last_fullsized":"2024-09-17T04:09:45.486906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487276+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:09:45.487276+0000","last_peered":"2024-09-17T04:09:45.487276+0000","last_clean":"2024-09-17T04:09:45.487276+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:09:45.487276+0000","last_undegraded":"2024-09-17T04:09:45.487276+0000","last_fullsized":"2024-09-17T04:09:45.487276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381357+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:09:45.381357+0000","last_peered":"2024-09-17T04:09:45.381357+0000","last_clean":"2024-09-17T04:09:45.381357+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:09:45.381357+0000","last_undegraded":"2024-09-17T04:09:45.381357+0000","last_fullsized":"2024-09-17T04:09:45.381357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489675+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:09:45.489675+0000","last_peered":"2024-09-17T04:09:45.489675+0000","last_clean":"2024-09-17T04:09:45.489675+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:09:45.489675+0000","last_undegraded":"2024-09-17T04:09:45.489675+0000","last_fullsized":"2024-09-17T04:09:45.489675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488762+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:09:45.488762+0000","last_peered":"2024-09-17T04:09:45.488762+0000","last_clean":"2024-09-17T04:09:45.488762+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:09:45.488762+0000","last_undegraded":"2024-09-17T04:09:45.488762+0000","last_fullsized":"2024-09-17T04:09:45.488762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380081+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:09:45.380081+0000","last_peered":"2024-09-17T04:09:45.380081+0000","last_clean":"2024-09-17T04:09:45.380081+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:09:45.380081+0000","last_undegraded":"2024-09-17T04:09:45.380081+0000","last_fullsized":"2024-09-17T04:09:45.380081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487686+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:09:45.487686+0000","last_peered":"2024-09-17T04:09:45.487686+0000","last_clean":"2024-09-17T04:09:45.487686+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:09:45.487686+0000","last_undegraded":"2024-09-17T04:09:45.487686+0000","last_fullsized":"2024-09-17T04:09:45.487686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376474+0000","last_change":"2024-09-17T04:09:44.390631+0000","last_active":"2024-09-17T04:09:45.376474+0000","last_peered":"2024-09-17T04:09:45.376474+0000","last_clean":"2024-09-17T04:09:45.376474+0000","last_became_active":"2024-09-17T04:09:44.390199+0000","last_became_peered":"2024-09-17T04:09:44.390199+0000","last_unstale":"2024-09-17T04:09:45.376474+0000","last_undegraded":"2024-09-17T04:09:45.376474+0000","last_fullsized":"2024-09-17T04:09:45.376474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:45.662654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487776+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:09:45.487776+0000","last_peered":"2024-09-17T04:09:45.487776+0000","last_clean":"2024-09-17T04:09:45.487776+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:09:45.487776+0000","last_undegraded":"2024-09-17T04:09:45.487776+0000","last_fullsized":"2024-09-17T04:09:45.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380623+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:09:45.380623+0000","last_peered":"2024-09-17T04:09:45.380623+0000","last_clean":"2024-09-17T04:09:45.380623+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:09:45.380623+0000","last_undegraded":"2024-09-17T04:09:45.380623+0000","last_fullsized":"2024-09-17T04:09:45.380623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487823+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:09:45.487823+0000","last_peered":"2024-09-17T04:09:45.487823+0000","last_clean":"2024-09-17T04:09:45.487823+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:09:45.487823+0000","last_undegraded":"2024-09-17T04:09:45.487823+0000","last_fullsized":"2024-09-17T04:09:45.487823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379391+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:09:45.379391+0000","last_peered":"2024-09-17T04:09:45.379391+0000","last_clean":"2024-09-17T04:09:45.379391+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:09:45.379391+0000","last_undegraded":"2024-09-17T04:09:45.379391+0000","last_fullsized":"2024-09-17T04:09:45.379391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376223+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:09:45.376223+0000","last_peered":"2024-09-17T04:09:45.376223+0000","last_clean":"2024-09-17T04:09:45.376223+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:09:45.376223+0000","last_undegraded":"2024-09-17T04:09:45.376223+0000","last_fullsized":"2024-09-17T04:09:45.376223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488269+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:09:45.488269+0000","last_peered":"2024-09-17T04:09:45.488269+0000","last_clean":"2024-09-17T04:09:45.488269+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:09:45.488269+0000","last_undegraded":"2024-09-17T04:09:45.488269+0000","last_fullsized":"2024-09-17T04:09:45.488269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487587+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:09:45.487587+0000","last_peered":"2024-09-17T04:09:45.487587+0000","last_clean":"2024-09-17T04:09:45.487587+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:09:45.487587+0000","last_undegraded":"2024-09-17T04:09:45.487587+0000","last_fullsized":"2024-09-17T04:09:45.487587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489584+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:09:45.489584+0000","last_peered":"2024-09-17T04:09:45.489584+0000","last_clean":"2024-09-17T04:09:45.489584+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:09:45.489584+0000","last_undegraded":"2024-09-17T04:09:45.489584+0000","last_fullsized":"2024-09-17T04:09:45.489584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381271+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:09:45.381271+0000","last_peered":"2024-09-17T04:09:45.381271+0000","last_clean":"2024-09-17T04:09:45.381271+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:09:45.381271+0000","last_undegraded":"2024-09-17T04:09:45.381271+0000","last_fullsized":"2024-09-17T04:09:45.381271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488639+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:09:45.488639+0000","last_peered":"2024-09-17T04:09:45.488639+0000","last_clean":"2024-09-17T04:09:45.488639+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:09:45.488639+0000","last_undegraded":"2024-09-17T04:09:45.488639+0000","last_fullsized":"2024-09-17T04:09:45.488639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487577+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:09:45.487577+0000","last_peered":"2024-09-17T04:09:45.487577+0000","last_clean":"2024-09-17T04:09:45.487577+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:09:45.487577+0000","last_undegraded":"2024-09-17T04:09:45.487577+0000","last_fullsized":"2024-09-17T04:09:45.487577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488654+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:09:45.488654+0000","last_peered":"2024-09-17T04:09:45.488654+0000","last_clean":"2024-09-17T04:09:45.488654+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:09:45.488654+0000","last_undegraded":"2024-09-17T04:09:45.488654+0000","last_fullsized":"2024-09-17T04:09:45.488654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487259+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:09:45.487259+0000","last_peered":"2024-09-17T04:09:45.487259+0000","last_clean":"2024-09-17T04:09:45.487259+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:09:45.487259+0000","last_undegraded":"2024-09-17T04:09:45.487259+0000","last_fullsized":"2024-09-17T04:09:45.487259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380298+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:09:45.380298+0000","last_peered":"2024-09-17T04:09:45.380298+0000","last_clean":"2024-09-17T04:09:45.380298+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:09:45.380298+0000","last_undegraded":"2024-09-17T04:09:45.380298+0000","last_fullsized":"2024-09-17T04:09:45.380298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488632+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:09:45.488632+0000","last_peered":"2024-09-17T04:09:45.488632+0000","last_clean":"2024-09-17T04:09:45.488632+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:09:45.488632+0000","last_undegraded":"2024-09-17T04:09:45.488632+0000","last_fullsized":"2024-09-17T04:09:45.488632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376559+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:09:45.376559+0000","last_peered":"2024-09-17T04:09:45.376559+0000","last_clean":"2024-09-17T04:09:45.376559+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:09:45.376559+0000","last_undegraded":"2024-09-17T04:09:45.376559+0000","last_fullsized":"2024-09-17T04:09:45.376559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488714+0000","last_change":"2024-09-17T04:09:40.357971+0000","last_active":"2024-09-17T04:09:45.488714+0000","last_peered":"2024-09-17T04:09:45.488714+0000","last_clean":"2024-09-17T04:09:45.488714+0000","last_became_active":"2024-09-17T04:09:40.357694+0000","last_became_peered":"2024-09-17T04:09:40.357694+0000","last_unstale":"2024-09-17T04:09:45.488714+0000","last_undegraded":"2024-09-17T04:09:45.488714+0000","last_fullsized":"2024-09-17T04:09:45.488714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487015+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:09:45.487015+0000","last_peered":"2024-09-17T04:09:45.487015+0000","last_clean":"2024-09-17T04:09:45.487015+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:09:45.487015+0000","last_undegraded":"2024-09-17T04:09:45.487015+0000","last_fullsized":"2024-09-17T04:09:45.487015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487021+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:09:45.487021+0000","last_peered":"2024-09-17T04:09:45.487021+0000","last_clean":"2024-09-17T04:09:45.487021+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:09:45.487021+0000","last_undegraded":"2024-09-17T04:09:45.487021+0000","last_fullsized":"2024-09-17T04:09:45.487021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381785+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:09:45.381785+0000","last_peered":"2024-09-17T04:09:45.381785+0000","last_clean":"2024-09-17T04:09:45.381785+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:09:45.381785+0000","last_undegraded":"2024-09-17T04:09:45.381785+0000","last_fullsized":"2024-09-17T04:09:45.381785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380952+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:09:45.380952+0000","last_peered":"2024-09-17T04:09:45.380952+0000","last_clean":"2024-09-17T04:09:45.380952+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:09:45.380952+0000","last_undegraded":"2024-09-17T04:09:45.380952+0000","last_fullsized":"2024-09-17T04:09:45.380952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381260+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:09:45.381260+0000","last_peered":"2024-09-17T04:09:45.381260+0000","last_clean":"2024-09-17T04:09:45.381260+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:09:45.381260+0000","last_undegraded":"2024-09-17T04:09:45.381260+0000","last_fullsized":"2024-09-17T04:09:45.381260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488192+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:09:45.488192+0000","last_peered":"2024-09-17T04:09:45.488192+0000","last_clean":"2024-09-17T04:09:45.488192+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:09:45.488192+0000","last_undegraded":"2024-09-17T04:09:45.488192+0000","last_fullsized":"2024-09-17T04:09:45.488192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489513+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:09:45.489513+0000","last_peered":"2024-09-17T04:09:45.489513+0000","last_clean":"2024-09-17T04:09:45.489513+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:09:45.489513+0000","last_undegraded":"2024-09-17T04:09:45.489513+0000","last_fullsized":"2024-09-17T04:09:45.489513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487054+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:09:45.487054+0000","last_peered":"2024-09-17T04:09:45.487054+0000","last_clean":"2024-09-17T04:09:45.487054+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:09:45.487054+0000","last_undegraded":"2024-09-17T04:09:45.487054+0000","last_fullsized":"2024-09-17T04:09:45.487054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488027+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:09:45.488027+0000","last_peered":"2024-09-17T04:09:45.488027+0000","last_clean":"2024-09-17T04:09:45.488027+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:09:45.488027+0000","last_undegraded":"2024-09-17T04:09:45.488027+0000","last_fullsized":"2024-09-17T04:09:45.488027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487515+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:09:45.487515+0000","last_peered":"2024-09-17T04:09:45.487515+0000","last_clean":"2024-09-17T04:09:45.487515+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:09:45.487515+0000","last_undegraded":"2024-09-17T04:09:45.487515+0000","last_fullsized":"2024-09-17T04:09:45.487515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488105+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:09:45.488105+0000","last_peered":"2024-09-17T04:09:45.488105+0000","last_clean":"2024-09-17T04:09:45.488105+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:09:45.488105+0000","last_undegraded":"2024-09-17T04:09:45.488105+0000","last_fullsized":"2024-09-17T04:09:45.488105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487102+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:09:45.487102+0000","last_peered":"2024-09-17T04:09:45.487102+0000","last_clean":"2024-09-17T04:09:45.487102+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:09:45.487102+0000","last_undegraded":"2024-09-17T04:09:45.487102+0000","last_fullsized":"2024-09-17T04:09:45.487102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489059+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:09:45.489059+0000","last_peered":"2024-09-17T04:09:45.489059+0000","last_clean":"2024-09-17T04:09:45.489059+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:09:45.489059+0000","last_undegraded":"2024-09-17T04:09:45.489059+0000","last_fullsized":"2024-09-17T04:09:45.489059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488026+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:09:45.488026+0000","last_peered":"2024-09-17T04:09:45.488026+0000","last_clean":"2024-09-17T04:09:45.488026+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:09:45.488026+0000","last_undegraded":"2024-09-17T04:09:45.488026+0000","last_fullsized":"2024-09-17T04:09:45.488026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":702305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":112967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":111481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":112967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":111355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":702361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:09:54.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.558+0000 7fae1e09b640 1 -- 172.21.15.104:0/1933791324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 msgr2=0x7fae180b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.558+0000 7fae1e09b640 1 --2- 172.21.15.104:0/1933791324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae180b3270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae1808d3b0 tx=0x7fae1002a560 comp rx=0 tx=0).stop 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 -- 172.21.15.104:0/1933791324 shutdown_connections 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 --2- 172.21.15.104:0/1933791324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae180b3270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 --2- 172.21.15.104:0/1933791324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 0x7fae181629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 --2- 172.21.15.104:0/1933791324 >> v2:172.21.15.192:3300/0 conn(0x7fae180cfe00 0x7fae180d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 -- 172.21.15.104:0/1933791324 >> 172.21.15.104:0/1933791324 conn(0x7fae180d4440 msgr2=0x7fae180d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 -- 172.21.15.104:0/1933791324 shutdown_connections 2024-09-17T04:09:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.559+0000 7fae1e09b640 1 -- 172.21.15.104:0/1933791324 wait complete. 2024-09-17T04:09:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.560+0000 7fae1e09b640 1 Processor -- start 2024-09-17T04:09:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.561+0000 7fae1e09b640 1 -- start start 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae180cfe00 0x7fae18161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 0x7fae181615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fae180b37b0 con 0x7fae180b2e60 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae180cf5a0 con 0x7fae180cfe00 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae1e09b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae180b3930 con 0x7fae18162590 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55178/0 (socket says 172.21.15.104:55178) 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 -- 172.21.15.104:0/2399429330 learned_addr learned my addr 172.21.15.104:0/2399429330 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae16ffd640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae180cfe00 0x7fae18161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae17fff640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 0x7fae181615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 -- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 msgr2=0x7fae181615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 0x7fae181615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 -- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae180cfe00 msgr2=0x7fae18161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae180cfe00 0x7fae18161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.562+0000 7fae177fe640 1 -- 172.21.15.104:0/2399429330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae181f5ab0 con 0x7fae180b2e60 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fae177fe640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fae0800cd10 tx=0x7fae08007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004b20 con 0x7fae180b2e60 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae08004db0 con 0x7fae180b2e60 2024-09-17T04:09:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08005280 con 0x7fae180b2e60 2024-09-17T04:09:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae181f5d90 con 0x7fae180b2e60 2024-09-17T04:09:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.563+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181f6350 con 0x7fae180b2e60 2024-09-17T04:09:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.564+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae180d2a20 con 0x7fae180b2e60 2024-09-17T04:09:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.565+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae08005420 con 0x7fae180b2e60 2024-09-17T04:09:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.565+0000 7fadfffff640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 0x7fae0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.565+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fae0809b7e0 con 0x7fae180b2e60 2024-09-17T04:09:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.565+0000 7fae16ffd640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 0x7fae0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.566+0000 7fae16ffd640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 0x7fae0407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae1806e520 tx=0x7fae0c005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.569+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae08014030 con 0x7fae180b2e60 2024-09-17T04:09:54.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.744+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae1806e8c0 con 0x7fae04078bc0 2024-09-17T04:09:54.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.750+0000 7fadfffff640 1 -- 172.21.15.104:0/2399429330 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332619 (secure 0 0 0) 0x7fae1806e8c0 con 0x7fae04078bc0 2024-09-17T04:09:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:54.754 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 msgr2=0x7fae0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 0x7fae0407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae1806e520 tx=0x7fae0c005f60 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 msgr2=0x7fae181f9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fae0800cd10 tx=0x7fae08007590 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 shutdown_connections 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fae04078bc0 0x7fae0407b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae180cfe00 0x7fae18161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae18162590 0x7fae181615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 --2- 172.21.15.104:0/2399429330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae180b2e60 0x7fae181f9460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 >> 172.21.15.104:0/2399429330 conn(0x7fae180d4440 msgr2=0x7fae180b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 shutdown_connections 2024-09-17T04:09:54.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.754+0000 7fae1e09b640 1 -- 172.21.15.104:0/2399429330 wait complete. 2024-09-17T04:09:54.765 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T04:09:53.346207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3514368,"data_stored":2076396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.982377"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488204+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:09:45.488204+0000","last_peered":"2024-09-17T04:09:45.488204+0000","last_clean":"2024-09-17T04:09:45.488204+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:09:45.488204+0000","last_undegraded":"2024-09-17T04:09:45.488204+0000","last_fullsized":"2024-09-17T04:09:45.488204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487142+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:09:45.487142+0000","last_peered":"2024-09-17T04:09:45.487142+0000","last_clean":"2024-09-17T04:09:45.487142+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:09:45.487142+0000","last_undegraded":"2024-09-17T04:09:45.487142+0000","last_fullsized":"2024-09-17T04:09:45.487142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488102+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:09:45.488102+0000","last_peered":"2024-09-17T04:09:45.488102+0000","last_clean":"2024-09-17T04:09:45.488102+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:09:45.488102+0000","last_undegraded":"2024-09-17T04:09:45.488102+0000","last_fullsized":"2024-09-17T04:09:45.488102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487419+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:09:45.487419+0000","last_peered":"2024-09-17T04:09:45.487419+0000","last_clean":"2024-09-17T04:09:45.487419+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:09:45.487419+0000","last_undegraded":"2024-09-17T04:09:45.487419+0000","last_fullsized":"2024-09-17T04:09:45.487419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487870+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:09:45.487870+0000","last_peered":"2024-09-17T04:09:45.487870+0000","last_clean":"2024-09-17T04:09:45.487870+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:09:45.487870+0000","last_undegraded":"2024-09-17T04:09:45.487870+0000","last_fullsized":"2024-09-17T04:09:45.487870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381185+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:09:45.381185+0000","last_peered":"2024-09-17T04:09:45.381185+0000","last_clean":"2024-09-17T04:09:45.381185+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:09:45.381185+0000","last_undegraded":"2024-09-17T04:09:45.381185+0000","last_fullsized":"2024-09-17T04:09:45.381185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488189+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:09:45.488189+0000","last_peered":"2024-09-17T04:09:45.488189+0000","last_clean":"2024-09-17T04:09:45.488189+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:09:45.488189+0000","last_undegraded":"2024-09-17T04:09:45.488189+0000","last_fullsized":"2024-09-17T04:09:45.488189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488154+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:09:45.488154+0000","last_peered":"2024-09-17T04:09:45.488154+0000","last_clean":"2024-09-17T04:09:45.488154+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:09:45.488154+0000","last_undegraded":"2024-09-17T04:09:45.488154+0000","last_fullsized":"2024-09-17T04:09:45.488154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380765+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:09:45.380765+0000","last_peered":"2024-09-17T04:09:45.380765+0000","last_clean":"2024-09-17T04:09:45.380765+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:09:45.380765+0000","last_undegraded":"2024-09-17T04:09:45.380765+0000","last_fullsized":"2024-09-17T04:09:45.380765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488356+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:09:45.488356+0000","last_peered":"2024-09-17T04:09:45.488356+0000","last_clean":"2024-09-17T04:09:45.488356+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:09:45.488356+0000","last_undegraded":"2024-09-17T04:09:45.488356+0000","last_fullsized":"2024-09-17T04:09:45.488356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380259+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:09:45.380259+0000","last_peered":"2024-09-17T04:09:45.380259+0000","last_clean":"2024-09-17T04:09:45.380259+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:09:45.380259+0000","last_undegraded":"2024-09-17T04:09:45.380259+0000","last_fullsized":"2024-09-17T04:09:45.380259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380346+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:09:45.380346+0000","last_peered":"2024-09-17T04:09:45.380346+0000","last_clean":"2024-09-17T04:09:45.380346+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:09:45.380346+0000","last_undegraded":"2024-09-17T04:09:45.380346+0000","last_fullsized":"2024-09-17T04:09:45.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487865+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:09:45.487865+0000","last_peered":"2024-09-17T04:09:45.487865+0000","last_clean":"2024-09-17T04:09:45.487865+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:09:45.487865+0000","last_undegraded":"2024-09-17T04:09:45.487865+0000","last_fullsized":"2024-09-17T04:09:45.487865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379933+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:09:45.379933+0000","last_peered":"2024-09-17T04:09:45.379933+0000","last_clean":"2024-09-17T04:09:45.379933+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:09:45.379933+0000","last_undegraded":"2024-09-17T04:09:45.379933+0000","last_fullsized":"2024-09-17T04:09:45.379933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487666+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:09:45.487666+0000","last_peered":"2024-09-17T04:09:45.487666+0000","last_clean":"2024-09-17T04:09:45.487666+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:09:45.487666+0000","last_undegraded":"2024-09-17T04:09:45.487666+0000","last_fullsized":"2024-09-17T04:09:45.487666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489005+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:09:45.489005+0000","last_peered":"2024-09-17T04:09:45.489005+0000","last_clean":"2024-09-17T04:09:45.489005+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:09:45.489005+0000","last_undegraded":"2024-09-17T04:09:45.489005+0000","last_fullsized":"2024-09-17T04:09:45.489005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381675+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:09:45.381675+0000","last_peered":"2024-09-17T04:09:45.381675+0000","last_clean":"2024-09-17T04:09:45.381675+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:09:45.381675+0000","last_undegraded":"2024-09-17T04:09:45.381675+0000","last_fullsized":"2024-09-17T04:09:45.381675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489776+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:09:45.489776+0000","last_peered":"2024-09-17T04:09:45.489776+0000","last_clean":"2024-09-17T04:09:45.489776+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:09:45.489776+0000","last_undegraded":"2024-09-17T04:09:45.489776+0000","last_fullsized":"2024-09-17T04:09:45.489776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487117+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:09:45.487117+0000","last_peered":"2024-09-17T04:09:45.487117+0000","last_clean":"2024-09-17T04:09:45.487117+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:09:45.487117+0000","last_undegraded":"2024-09-17T04:09:45.487117+0000","last_fullsized":"2024-09-17T04:09:45.487117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489018+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:09:45.489018+0000","last_peered":"2024-09-17T04:09:45.489018+0000","last_clean":"2024-09-17T04:09:45.489018+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:09:45.489018+0000","last_undegraded":"2024-09-17T04:09:45.489018+0000","last_fullsized":"2024-09-17T04:09:45.489018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.382031+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:09:45.382031+0000","last_peered":"2024-09-17T04:09:45.382031+0000","last_clean":"2024-09-17T04:09:45.382031+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:09:45.382031+0000","last_undegraded":"2024-09-17T04:09:45.382031+0000","last_fullsized":"2024-09-17T04:09:45.382031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486989+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:09:45.486989+0000","last_peered":"2024-09-17T04:09:45.486989+0000","last_clean":"2024-09-17T04:09:45.486989+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:09:45.486989+0000","last_undegraded":"2024-09-17T04:09:45.486989+0000","last_fullsized":"2024-09-17T04:09:45.486989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379739+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:09:45.379739+0000","last_peered":"2024-09-17T04:09:45.379739+0000","last_clean":"2024-09-17T04:09:45.379739+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:09:45.379739+0000","last_undegraded":"2024-09-17T04:09:45.379739+0000","last_fullsized":"2024-09-17T04:09:45.379739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488557+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:09:45.488557+0000","last_peered":"2024-09-17T04:09:45.488557+0000","last_clean":"2024-09-17T04:09:45.488557+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:09:45.488557+0000","last_undegraded":"2024-09-17T04:09:45.488557+0000","last_fullsized":"2024-09-17T04:09:45.488557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381554+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:09:45.381554+0000","last_peered":"2024-09-17T04:09:45.381554+0000","last_clean":"2024-09-17T04:09:45.381554+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:09:45.381554+0000","last_undegraded":"2024-09-17T04:09:45.381554+0000","last_fullsized":"2024-09-17T04:09:45.381554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381830+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:09:45.381830+0000","last_peered":"2024-09-17T04:09:45.381830+0000","last_clean":"2024-09-17T04:09:45.381830+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:09:45.381830+0000","last_undegraded":"2024-09-17T04:09:45.381830+0000","last_fullsized":"2024-09-17T04:09:45.381830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488750+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:09:45.488750+0000","last_peered":"2024-09-17T04:09:45.488750+0000","last_clean":"2024-09-17T04:09:45.488750+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:09:45.488750+0000","last_undegraded":"2024-09-17T04:09:45.488750+0000","last_fullsized":"2024-09-17T04:09:45.488750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489146+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:09:45.489146+0000","last_peered":"2024-09-17T04:09:45.489146+0000","last_clean":"2024-09-17T04:09:45.489146+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:09:45.489146+0000","last_undegraded":"2024-09-17T04:09:45.489146+0000","last_fullsized":"2024-09-17T04:09:45.489146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489258+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:09:45.489258+0000","last_peered":"2024-09-17T04:09:45.489258+0000","last_clean":"2024-09-17T04:09:45.489258+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:09:45.489258+0000","last_undegraded":"2024-09-17T04:09:45.489258+0000","last_fullsized":"2024-09-17T04:09:45.489258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489441+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:09:45.489441+0000","last_peered":"2024-09-17T04:09:45.489441+0000","last_clean":"2024-09-17T04:09:45.489441+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:09:45.489441+0000","last_undegraded":"2024-09-17T04:09:45.489441+0000","last_fullsized":"2024-09-17T04:09:45.489441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488314+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:09:45.488314+0000","last_peered":"2024-09-17T04:09:45.488314+0000","last_clean":"2024-09-17T04:09:45.488314+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:09:45.488314+0000","last_undegraded":"2024-09-17T04:09:45.488314+0000","last_fullsized":"2024-09-17T04:09:45.488314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487080+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:09:45.487080+0000","last_peered":"2024-09-17T04:09:45.487080+0000","last_clean":"2024-09-17T04:09:45.487080+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:09:45.487080+0000","last_undegraded":"2024-09-17T04:09:45.487080+0000","last_fullsized":"2024-09-17T04:09:45.487080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488377+0000","last_change":"2024-09-17T04:09:40.352259+0000","last_active":"2024-09-17T04:09:45.488377+0000","last_peered":"2024-09-17T04:09:45.488377+0000","last_clean":"2024-09-17T04:09:45.488377+0000","last_became_active":"2024-09-17T04:09:40.351940+0000","last_became_peered":"2024-09-17T04:09:40.351940+0000","last_unstale":"2024-09-17T04:09:45.488377+0000","last_undegraded":"2024-09-17T04:09:45.488377+0000","last_fullsized":"2024-09-17T04:09:45.488377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489543+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:09:45.489543+0000","last_peered":"2024-09-17T04:09:45.489543+0000","last_clean":"2024-09-17T04:09:45.489543+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:09:45.489543+0000","last_undegraded":"2024-09-17T04:09:45.489543+0000","last_fullsized":"2024-09-17T04:09:45.489543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488788+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:09:45.488788+0000","last_peered":"2024-09-17T04:09:45.488788+0000","last_clean":"2024-09-17T04:09:45.488788+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:09:45.488788+0000","last_undegraded":"2024-09-17T04:09:45.488788+0000","last_fullsized":"2024-09-17T04:09:45.488788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381892+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:09:45.381892+0000","last_peered":"2024-09-17T04:09:45.381892+0000","last_clean":"2024-09-17T04:09:45.381892+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:09:45.381892+0000","last_undegraded":"2024-09-17T04:09:45.381892+0000","last_fullsized":"2024-09-17T04:09:45.381892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488433+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:09:45.488433+0000","last_peered":"2024-09-17T04:09:45.488433+0000","last_clean":"2024-09-17T04:09:45.488433+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:09:45.488433+0000","last_undegraded":"2024-09-17T04:09:45.488433+0000","last_fullsized":"2024-09-17T04:09:45.488433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489278+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:09:45.489278+0000","last_peered":"2024-09-17T04:09:45.489278+0000","last_clean":"2024-09-17T04:09:45.489278+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:09:45.489278+0000","last_undegraded":"2024-09-17T04:09:45.489278+0000","last_fullsized":"2024-09-17T04:09:45.489278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487967+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:09:45.487967+0000","last_peered":"2024-09-17T04:09:45.487967+0000","last_clean":"2024-09-17T04:09:45.487967+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:09:45.487967+0000","last_undegraded":"2024-09-17T04:09:45.487967+0000","last_fullsized":"2024-09-17T04:09:45.487967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376260+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:09:45.376260+0000","last_peered":"2024-09-17T04:09:45.376260+0000","last_clean":"2024-09-17T04:09:45.376260+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:09:45.376260+0000","last_undegraded":"2024-09-17T04:09:45.376260+0000","last_fullsized":"2024-09-17T04:09:45.376260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488812+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:09:45.488812+0000","last_peered":"2024-09-17T04:09:45.488812+0000","last_clean":"2024-09-17T04:09:45.488812+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:09:45.488812+0000","last_undegraded":"2024-09-17T04:09:45.488812+0000","last_fullsized":"2024-09-17T04:09:45.488812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486751+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:09:45.486751+0000","last_peered":"2024-09-17T04:09:45.486751+0000","last_clean":"2024-09-17T04:09:45.486751+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:09:45.486751+0000","last_undegraded":"2024-09-17T04:09:45.486751+0000","last_fullsized":"2024-09-17T04:09:45.486751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486996+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:09:45.486996+0000","last_peered":"2024-09-17T04:09:45.486996+0000","last_clean":"2024-09-17T04:09:45.486996+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:09:45.486996+0000","last_undegraded":"2024-09-17T04:09:45.486996+0000","last_fullsized":"2024-09-17T04:09:45.486996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488479+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:09:45.488479+0000","last_peered":"2024-09-17T04:09:45.488479+0000","last_clean":"2024-09-17T04:09:45.488479+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:09:45.488479+0000","last_undegraded":"2024-09-17T04:09:45.488479+0000","last_fullsized":"2024-09-17T04:09:45.488479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487202+0000","last_change":"2024-09-17T04:09:40.352550+0000","last_active":"2024-09-17T04:09:45.487202+0000","last_peered":"2024-09-17T04:09:45.487202+0000","last_clean":"2024-09-17T04:09:45.487202+0000","last_became_active":"2024-09-17T04:09:40.352245+0000","last_became_peered":"2024-09-17T04:09:40.352245+0000","last_unstale":"2024-09-17T04:09:45.487202+0000","last_undegraded":"2024-09-17T04:09:45.487202+0000","last_fullsized":"2024-09-17T04:09:45.487202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:30.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487781+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:09:45.487781+0000","last_peered":"2024-09-17T04:09:45.487781+0000","last_clean":"2024-09-17T04:09:45.487781+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:09:45.487781+0000","last_undegraded":"2024-09-17T04:09:45.487781+0000","last_fullsized":"2024-09-17T04:09:45.487781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487130+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:09:45.487130+0000","last_peered":"2024-09-17T04:09:45.487130+0000","last_clean":"2024-09-17T04:09:45.487130+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:09:45.487130+0000","last_undegraded":"2024-09-17T04:09:45.487130+0000","last_fullsized":"2024-09-17T04:09:45.487130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380658+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:09:45.380658+0000","last_peered":"2024-09-17T04:09:45.380658+0000","last_clean":"2024-09-17T04:09:45.380658+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:09:45.380658+0000","last_undegraded":"2024-09-17T04:09:45.380658+0000","last_fullsized":"2024-09-17T04:09:45.380658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487996+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:09:45.487996+0000","last_peered":"2024-09-17T04:09:45.487996+0000","last_clean":"2024-09-17T04:09:45.487996+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:09:45.487996+0000","last_undegraded":"2024-09-17T04:09:45.487996+0000","last_fullsized":"2024-09-17T04:09:45.487996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376608+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:09:45.376608+0000","last_peered":"2024-09-17T04:09:45.376608+0000","last_clean":"2024-09-17T04:09:45.376608+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:09:45.376608+0000","last_undegraded":"2024-09-17T04:09:45.376608+0000","last_fullsized":"2024-09-17T04:09:45.376608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379735+0000","last_change":"2024-09-17T04:09:44.490924+0000","last_active":"2024-09-17T04:09:45.379735+0000","last_peered":"2024-09-17T04:09:45.379735+0000","last_clean":"2024-09-17T04:09:45.379735+0000","last_became_active":"2024-09-17T04:09:44.490464+0000","last_became_peered":"2024-09-17T04:09:44.490464+0000","last_unstale":"2024-09-17T04:09:45.379735+0000","last_undegraded":"2024-09-17T04:09:45.379735+0000","last_fullsized":"2024-09-17T04:09:45.379735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:07.828382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488305+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:09:45.488305+0000","last_peered":"2024-09-17T04:09:45.488305+0000","last_clean":"2024-09-17T04:09:45.488305+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:09:45.488305+0000","last_undegraded":"2024-09-17T04:09:45.488305+0000","last_fullsized":"2024-09-17T04:09:45.488305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488284+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:09:45.488284+0000","last_peered":"2024-09-17T04:09:45.488284+0000","last_clean":"2024-09-17T04:09:45.488284+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:09:45.488284+0000","last_undegraded":"2024-09-17T04:09:45.488284+0000","last_fullsized":"2024-09-17T04:09:45.488284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487424+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:09:45.487424+0000","last_peered":"2024-09-17T04:09:45.487424+0000","last_clean":"2024-09-17T04:09:45.487424+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:09:45.487424+0000","last_undegraded":"2024-09-17T04:09:45.487424+0000","last_fullsized":"2024-09-17T04:09:45.487424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488308+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:09:45.488308+0000","last_peered":"2024-09-17T04:09:45.488308+0000","last_clean":"2024-09-17T04:09:45.488308+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:09:45.488308+0000","last_undegraded":"2024-09-17T04:09:45.488308+0000","last_fullsized":"2024-09-17T04:09:45.488308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376681+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:09:45.376681+0000","last_peered":"2024-09-17T04:09:45.376681+0000","last_clean":"2024-09-17T04:09:45.376681+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:09:45.376681+0000","last_undegraded":"2024-09-17T04:09:45.376681+0000","last_fullsized":"2024-09-17T04:09:45.376681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486994+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:09:45.486994+0000","last_peered":"2024-09-17T04:09:45.486994+0000","last_clean":"2024-09-17T04:09:45.486994+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:09:45.486994+0000","last_undegraded":"2024-09-17T04:09:45.486994+0000","last_fullsized":"2024-09-17T04:09:45.486994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488529+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:09:45.488529+0000","last_peered":"2024-09-17T04:09:45.488529+0000","last_clean":"2024-09-17T04:09:45.488529+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:09:45.488529+0000","last_undegraded":"2024-09-17T04:09:45.488529+0000","last_fullsized":"2024-09-17T04:09:45.488529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381107+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:09:45.381107+0000","last_peered":"2024-09-17T04:09:45.381107+0000","last_clean":"2024-09-17T04:09:45.381107+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:09:45.381107+0000","last_undegraded":"2024-09-17T04:09:45.381107+0000","last_fullsized":"2024-09-17T04:09:45.381107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380901+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:09:45.380901+0000","last_peered":"2024-09-17T04:09:45.380901+0000","last_clean":"2024-09-17T04:09:45.380901+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:09:45.380901+0000","last_undegraded":"2024-09-17T04:09:45.380901+0000","last_fullsized":"2024-09-17T04:09:45.380901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487226+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:09:45.487226+0000","last_peered":"2024-09-17T04:09:45.487226+0000","last_clean":"2024-09-17T04:09:45.487226+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:09:45.487226+0000","last_undegraded":"2024-09-17T04:09:45.487226+0000","last_fullsized":"2024-09-17T04:09:45.487226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376124+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:09:45.376124+0000","last_peered":"2024-09-17T04:09:45.376124+0000","last_clean":"2024-09-17T04:09:45.376124+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:09:45.376124+0000","last_undegraded":"2024-09-17T04:09:45.376124+0000","last_fullsized":"2024-09-17T04:09:45.376124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488264+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:09:45.488264+0000","last_peered":"2024-09-17T04:09:45.488264+0000","last_clean":"2024-09-17T04:09:45.488264+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:09:45.488264+0000","last_undegraded":"2024-09-17T04:09:45.488264+0000","last_fullsized":"2024-09-17T04:09:45.488264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379655+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:09:45.379655+0000","last_peered":"2024-09-17T04:09:45.379655+0000","last_clean":"2024-09-17T04:09:45.379655+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:09:45.379655+0000","last_undegraded":"2024-09-17T04:09:45.379655+0000","last_fullsized":"2024-09-17T04:09:45.379655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379962+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:09:45.379962+0000","last_peered":"2024-09-17T04:09:45.379962+0000","last_clean":"2024-09-17T04:09:45.379962+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:09:45.379962+0000","last_undegraded":"2024-09-17T04:09:45.379962+0000","last_fullsized":"2024-09-17T04:09:45.379962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488461+0000","last_change":"2024-09-17T04:09:44.494839+0000","last_active":"2024-09-17T04:09:45.488461+0000","last_peered":"2024-09-17T04:09:45.488461+0000","last_clean":"2024-09-17T04:09:45.488461+0000","last_became_active":"2024-09-17T04:09:44.494396+0000","last_became_peered":"2024-09-17T04:09:44.494396+0000","last_unstale":"2024-09-17T04:09:45.488461+0000","last_undegraded":"2024-09-17T04:09:45.488461+0000","last_fullsized":"2024-09-17T04:09:45.488461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:45.786583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487743+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:09:45.487743+0000","last_peered":"2024-09-17T04:09:45.487743+0000","last_clean":"2024-09-17T04:09:45.487743+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:09:45.487743+0000","last_undegraded":"2024-09-17T04:09:45.487743+0000","last_fullsized":"2024-09-17T04:09:45.487743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488322+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:09:45.488322+0000","last_peered":"2024-09-17T04:09:45.488322+0000","last_clean":"2024-09-17T04:09:45.488322+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:09:45.488322+0000","last_undegraded":"2024-09-17T04:09:45.488322+0000","last_fullsized":"2024-09-17T04:09:45.488322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489197+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:09:45.489197+0000","last_peered":"2024-09-17T04:09:45.489197+0000","last_clean":"2024-09-17T04:09:45.489197+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:09:45.489197+0000","last_undegraded":"2024-09-17T04:09:45.489197+0000","last_fullsized":"2024-09-17T04:09:45.489197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487785+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:09:45.487785+0000","last_peered":"2024-09-17T04:09:45.487785+0000","last_clean":"2024-09-17T04:09:45.487785+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:09:45.487785+0000","last_undegraded":"2024-09-17T04:09:45.487785+0000","last_fullsized":"2024-09-17T04:09:45.487785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488190+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:09:45.488190+0000","last_peered":"2024-09-17T04:09:45.488190+0000","last_clean":"2024-09-17T04:09:45.488190+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:09:45.488190+0000","last_undegraded":"2024-09-17T04:09:45.488190+0000","last_fullsized":"2024-09-17T04:09:45.488190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487532+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:09:45.487532+0000","last_peered":"2024-09-17T04:09:45.487532+0000","last_clean":"2024-09-17T04:09:45.487532+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:09:45.487532+0000","last_undegraded":"2024-09-17T04:09:45.487532+0000","last_fullsized":"2024-09-17T04:09:45.487532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380427+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:09:45.380427+0000","last_peered":"2024-09-17T04:09:45.380427+0000","last_clean":"2024-09-17T04:09:45.380427+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:09:45.380427+0000","last_undegraded":"2024-09-17T04:09:45.380427+0000","last_fullsized":"2024-09-17T04:09:45.380427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488917+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:09:45.488917+0000","last_peered":"2024-09-17T04:09:45.488917+0000","last_clean":"2024-09-17T04:09:45.488917+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:09:45.488917+0000","last_undegraded":"2024-09-17T04:09:45.488917+0000","last_fullsized":"2024-09-17T04:09:45.488917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381857+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:09:45.381857+0000","last_peered":"2024-09-17T04:09:45.381857+0000","last_clean":"2024-09-17T04:09:45.381857+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:09:45.381857+0000","last_undegraded":"2024-09-17T04:09:45.381857+0000","last_fullsized":"2024-09-17T04:09:45.381857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488252+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:09:45.488252+0000","last_peered":"2024-09-17T04:09:45.488252+0000","last_clean":"2024-09-17T04:09:45.488252+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:09:45.488252+0000","last_undegraded":"2024-09-17T04:09:45.488252+0000","last_fullsized":"2024-09-17T04:09:45.488252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381469+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:09:45.381469+0000","last_peered":"2024-09-17T04:09:45.381469+0000","last_clean":"2024-09-17T04:09:45.381469+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:09:45.381469+0000","last_undegraded":"2024-09-17T04:09:45.381469+0000","last_fullsized":"2024-09-17T04:09:45.381469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488076+0000","last_change":"2024-09-17T04:09:40.340531+0000","last_active":"2024-09-17T04:09:45.488076+0000","last_peered":"2024-09-17T04:09:45.488076+0000","last_clean":"2024-09-17T04:09:45.488076+0000","last_became_active":"2024-09-17T04:09:40.340218+0000","last_became_peered":"2024-09-17T04:09:40.340218+0000","last_unstale":"2024-09-17T04:09:45.488076+0000","last_undegraded":"2024-09-17T04:09:45.488076+0000","last_fullsized":"2024-09-17T04:09:45.488076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488153+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:09:45.488153+0000","last_peered":"2024-09-17T04:09:45.488153+0000","last_clean":"2024-09-17T04:09:45.488153+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:09:45.488153+0000","last_undegraded":"2024-09-17T04:09:45.488153+0000","last_fullsized":"2024-09-17T04:09:45.488153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489688+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:09:45.489688+0000","last_peered":"2024-09-17T04:09:45.489688+0000","last_clean":"2024-09-17T04:09:45.489688+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:09:45.489688+0000","last_undegraded":"2024-09-17T04:09:45.489688+0000","last_fullsized":"2024-09-17T04:09:45.489688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488106+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:09:45.488106+0000","last_peered":"2024-09-17T04:09:45.488106+0000","last_clean":"2024-09-17T04:09:45.488106+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:09:45.488106+0000","last_undegraded":"2024-09-17T04:09:45.488106+0000","last_fullsized":"2024-09-17T04:09:45.488106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381382+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:09:45.381382+0000","last_peered":"2024-09-17T04:09:45.381382+0000","last_clean":"2024-09-17T04:09:45.381382+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:09:45.381382+0000","last_undegraded":"2024-09-17T04:09:45.381382+0000","last_fullsized":"2024-09-17T04:09:45.381382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488352+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:09:45.488352+0000","last_peered":"2024-09-17T04:09:45.488352+0000","last_clean":"2024-09-17T04:09:45.488352+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:09:45.488352+0000","last_undegraded":"2024-09-17T04:09:45.488352+0000","last_fullsized":"2024-09-17T04:09:45.488352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488015+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:09:45.488015+0000","last_peered":"2024-09-17T04:09:45.488015+0000","last_clean":"2024-09-17T04:09:45.488015+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:09:45.488015+0000","last_undegraded":"2024-09-17T04:09:45.488015+0000","last_fullsized":"2024-09-17T04:09:45.488015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486906+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:09:45.486906+0000","last_peered":"2024-09-17T04:09:45.486906+0000","last_clean":"2024-09-17T04:09:45.486906+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:09:45.486906+0000","last_undegraded":"2024-09-17T04:09:45.486906+0000","last_fullsized":"2024-09-17T04:09:45.486906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487276+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:09:45.487276+0000","last_peered":"2024-09-17T04:09:45.487276+0000","last_clean":"2024-09-17T04:09:45.487276+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:09:45.487276+0000","last_undegraded":"2024-09-17T04:09:45.487276+0000","last_fullsized":"2024-09-17T04:09:45.487276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381357+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:09:45.381357+0000","last_peered":"2024-09-17T04:09:45.381357+0000","last_clean":"2024-09-17T04:09:45.381357+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:09:45.381357+0000","last_undegraded":"2024-09-17T04:09:45.381357+0000","last_fullsized":"2024-09-17T04:09:45.381357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489675+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:09:45.489675+0000","last_peered":"2024-09-17T04:09:45.489675+0000","last_clean":"2024-09-17T04:09:45.489675+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:09:45.489675+0000","last_undegraded":"2024-09-17T04:09:45.489675+0000","last_fullsized":"2024-09-17T04:09:45.489675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488762+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:09:45.488762+0000","last_peered":"2024-09-17T04:09:45.488762+0000","last_clean":"2024-09-17T04:09:45.488762+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:09:45.488762+0000","last_undegraded":"2024-09-17T04:09:45.488762+0000","last_fullsized":"2024-09-17T04:09:45.488762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380081+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:09:45.380081+0000","last_peered":"2024-09-17T04:09:45.380081+0000","last_clean":"2024-09-17T04:09:45.380081+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:09:45.380081+0000","last_undegraded":"2024-09-17T04:09:45.380081+0000","last_fullsized":"2024-09-17T04:09:45.380081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487686+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:09:45.487686+0000","last_peered":"2024-09-17T04:09:45.487686+0000","last_clean":"2024-09-17T04:09:45.487686+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:09:45.487686+0000","last_undegraded":"2024-09-17T04:09:45.487686+0000","last_fullsized":"2024-09-17T04:09:45.487686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376474+0000","last_change":"2024-09-17T04:09:44.390631+0000","last_active":"2024-09-17T04:09:45.376474+0000","last_peered":"2024-09-17T04:09:45.376474+0000","last_clean":"2024-09-17T04:09:45.376474+0000","last_became_active":"2024-09-17T04:09:44.390199+0000","last_became_peered":"2024-09-17T04:09:44.390199+0000","last_unstale":"2024-09-17T04:09:45.376474+0000","last_undegraded":"2024-09-17T04:09:45.376474+0000","last_fullsized":"2024-09-17T04:09:45.376474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:45.662654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487776+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:09:45.487776+0000","last_peered":"2024-09-17T04:09:45.487776+0000","last_clean":"2024-09-17T04:09:45.487776+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:09:45.487776+0000","last_undegraded":"2024-09-17T04:09:45.487776+0000","last_fullsized":"2024-09-17T04:09:45.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380623+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:09:45.380623+0000","last_peered":"2024-09-17T04:09:45.380623+0000","last_clean":"2024-09-17T04:09:45.380623+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:09:45.380623+0000","last_undegraded":"2024-09-17T04:09:45.380623+0000","last_fullsized":"2024-09-17T04:09:45.380623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487823+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:09:45.487823+0000","last_peered":"2024-09-17T04:09:45.487823+0000","last_clean":"2024-09-17T04:09:45.487823+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:09:45.487823+0000","last_undegraded":"2024-09-17T04:09:45.487823+0000","last_fullsized":"2024-09-17T04:09:45.487823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379391+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:09:45.379391+0000","last_peered":"2024-09-17T04:09:45.379391+0000","last_clean":"2024-09-17T04:09:45.379391+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:09:45.379391+0000","last_undegraded":"2024-09-17T04:09:45.379391+0000","last_fullsized":"2024-09-17T04:09:45.379391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376223+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:09:45.376223+0000","last_peered":"2024-09-17T04:09:45.376223+0000","last_clean":"2024-09-17T04:09:45.376223+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:09:45.376223+0000","last_undegraded":"2024-09-17T04:09:45.376223+0000","last_fullsized":"2024-09-17T04:09:45.376223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488269+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:09:45.488269+0000","last_peered":"2024-09-17T04:09:45.488269+0000","last_clean":"2024-09-17T04:09:45.488269+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:09:45.488269+0000","last_undegraded":"2024-09-17T04:09:45.488269+0000","last_fullsized":"2024-09-17T04:09:45.488269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487587+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:09:45.487587+0000","last_peered":"2024-09-17T04:09:45.487587+0000","last_clean":"2024-09-17T04:09:45.487587+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:09:45.487587+0000","last_undegraded":"2024-09-17T04:09:45.487587+0000","last_fullsized":"2024-09-17T04:09:45.487587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489584+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:09:45.489584+0000","last_peered":"2024-09-17T04:09:45.489584+0000","last_clean":"2024-09-17T04:09:45.489584+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:09:45.489584+0000","last_undegraded":"2024-09-17T04:09:45.489584+0000","last_fullsized":"2024-09-17T04:09:45.489584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381271+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:09:45.381271+0000","last_peered":"2024-09-17T04:09:45.381271+0000","last_clean":"2024-09-17T04:09:45.381271+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:09:45.381271+0000","last_undegraded":"2024-09-17T04:09:45.381271+0000","last_fullsized":"2024-09-17T04:09:45.381271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488639+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:09:45.488639+0000","last_peered":"2024-09-17T04:09:45.488639+0000","last_clean":"2024-09-17T04:09:45.488639+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:09:45.488639+0000","last_undegraded":"2024-09-17T04:09:45.488639+0000","last_fullsized":"2024-09-17T04:09:45.488639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487577+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:09:45.487577+0000","last_peered":"2024-09-17T04:09:45.487577+0000","last_clean":"2024-09-17T04:09:45.487577+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:09:45.487577+0000","last_undegraded":"2024-09-17T04:09:45.487577+0000","last_fullsized":"2024-09-17T04:09:45.487577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488654+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:09:45.488654+0000","last_peered":"2024-09-17T04:09:45.488654+0000","last_clean":"2024-09-17T04:09:45.488654+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:09:45.488654+0000","last_undegraded":"2024-09-17T04:09:45.488654+0000","last_fullsized":"2024-09-17T04:09:45.488654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487259+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:09:45.487259+0000","last_peered":"2024-09-17T04:09:45.487259+0000","last_clean":"2024-09-17T04:09:45.487259+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:09:45.487259+0000","last_undegraded":"2024-09-17T04:09:45.487259+0000","last_fullsized":"2024-09-17T04:09:45.487259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380298+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:09:45.380298+0000","last_peered":"2024-09-17T04:09:45.380298+0000","last_clean":"2024-09-17T04:09:45.380298+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:09:45.380298+0000","last_undegraded":"2024-09-17T04:09:45.380298+0000","last_fullsized":"2024-09-17T04:09:45.380298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488632+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:09:45.488632+0000","last_peered":"2024-09-17T04:09:45.488632+0000","last_clean":"2024-09-17T04:09:45.488632+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:09:45.488632+0000","last_undegraded":"2024-09-17T04:09:45.488632+0000","last_fullsized":"2024-09-17T04:09:45.488632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376559+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:09:45.376559+0000","last_peered":"2024-09-17T04:09:45.376559+0000","last_clean":"2024-09-17T04:09:45.376559+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:09:45.376559+0000","last_undegraded":"2024-09-17T04:09:45.376559+0000","last_fullsized":"2024-09-17T04:09:45.376559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488714+0000","last_change":"2024-09-17T04:09:40.357971+0000","last_active":"2024-09-17T04:09:45.488714+0000","last_peered":"2024-09-17T04:09:45.488714+0000","last_clean":"2024-09-17T04:09:45.488714+0000","last_became_active":"2024-09-17T04:09:40.357694+0000","last_became_peered":"2024-09-17T04:09:40.357694+0000","last_unstale":"2024-09-17T04:09:45.488714+0000","last_undegraded":"2024-09-17T04:09:45.488714+0000","last_fullsized":"2024-09-17T04:09:45.488714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487015+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:09:45.487015+0000","last_peered":"2024-09-17T04:09:45.487015+0000","last_clean":"2024-09-17T04:09:45.487015+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:09:45.487015+0000","last_undegraded":"2024-09-17T04:09:45.487015+0000","last_fullsized":"2024-09-17T04:09:45.487015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487021+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:09:45.487021+0000","last_peered":"2024-09-17T04:09:45.487021+0000","last_clean":"2024-09-17T04:09:45.487021+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:09:45.487021+0000","last_undegraded":"2024-09-17T04:09:45.487021+0000","last_fullsized":"2024-09-17T04:09:45.487021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381785+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:09:45.381785+0000","last_peered":"2024-09-17T04:09:45.381785+0000","last_clean":"2024-09-17T04:09:45.381785+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:09:45.381785+0000","last_undegraded":"2024-09-17T04:09:45.381785+0000","last_fullsized":"2024-09-17T04:09:45.381785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380952+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:09:45.380952+0000","last_peered":"2024-09-17T04:09:45.380952+0000","last_clean":"2024-09-17T04:09:45.380952+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:09:45.380952+0000","last_undegraded":"2024-09-17T04:09:45.380952+0000","last_fullsized":"2024-09-17T04:09:45.380952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381260+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:09:45.381260+0000","last_peered":"2024-09-17T04:09:45.381260+0000","last_clean":"2024-09-17T04:09:45.381260+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:09:45.381260+0000","last_undegraded":"2024-09-17T04:09:45.381260+0000","last_fullsized":"2024-09-17T04:09:45.381260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488192+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:09:45.488192+0000","last_peered":"2024-09-17T04:09:45.488192+0000","last_clean":"2024-09-17T04:09:45.488192+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:09:45.488192+0000","last_undegraded":"2024-09-17T04:09:45.488192+0000","last_fullsized":"2024-09-17T04:09:45.488192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489513+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:09:45.489513+0000","last_peered":"2024-09-17T04:09:45.489513+0000","last_clean":"2024-09-17T04:09:45.489513+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:09:45.489513+0000","last_undegraded":"2024-09-17T04:09:45.489513+0000","last_fullsized":"2024-09-17T04:09:45.489513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487054+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:09:45.487054+0000","last_peered":"2024-09-17T04:09:45.487054+0000","last_clean":"2024-09-17T04:09:45.487054+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:09:45.487054+0000","last_undegraded":"2024-09-17T04:09:45.487054+0000","last_fullsized":"2024-09-17T04:09:45.487054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488027+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:09:45.488027+0000","last_peered":"2024-09-17T04:09:45.488027+0000","last_clean":"2024-09-17T04:09:45.488027+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:09:45.488027+0000","last_undegraded":"2024-09-17T04:09:45.488027+0000","last_fullsized":"2024-09-17T04:09:45.488027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487515+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:09:45.487515+0000","last_peered":"2024-09-17T04:09:45.487515+0000","last_clean":"2024-09-17T04:09:45.487515+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:09:45.487515+0000","last_undegraded":"2024-09-17T04:09:45.487515+0000","last_fullsized":"2024-09-17T04:09:45.487515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488105+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:09:45.488105+0000","last_peered":"2024-09-17T04:09:45.488105+0000","last_clean":"2024-09-17T04:09:45.488105+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:09:45.488105+0000","last_undegraded":"2024-09-17T04:09:45.488105+0000","last_fullsized":"2024-09-17T04:09:45.488105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487102+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:09:45.487102+0000","last_peered":"2024-09-17T04:09:45.487102+0000","last_clean":"2024-09-17T04:09:45.487102+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:09:45.487102+0000","last_undegraded":"2024-09-17T04:09:45.487102+0000","last_fullsized":"2024-09-17T04:09:45.487102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489059+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:09:45.489059+0000","last_peered":"2024-09-17T04:09:45.489059+0000","last_clean":"2024-09-17T04:09:45.489059+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:09:45.489059+0000","last_undegraded":"2024-09-17T04:09:45.489059+0000","last_fullsized":"2024-09-17T04:09:45.489059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488026+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:09:45.488026+0000","last_peered":"2024-09-17T04:09:45.488026+0000","last_clean":"2024-09-17T04:09:45.488026+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:09:45.488026+0000","last_undegraded":"2024-09-17T04:09:45.488026+0000","last_fullsized":"2024-09-17T04:09:45.488026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":702305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":112967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":111481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":112967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":111355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":702361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:09:54.769 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:09:54.770 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T04:09:54.770 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.918+0000 7fe042440640 1 -- 172.21.15.104:0/261324243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c15ee80 msgr2=0x7fe03c0d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.918+0000 7fe042440640 1 --2- 172.21.15.104:0/261324243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c15ee80 0x7fe03c0d0170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0b3c20 tx=0x7fe02c02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 -- 172.21.15.104:0/261324243 shutdown_connections 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 --2- 172.21.15.104:0/261324243 >> v2:172.21.15.192:3300/0 conn(0x7fe03c0ceb90 0x7fe03c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 --2- 172.21.15.104:0/261324243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c15ee80 0x7fe03c0d0170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 -- 172.21.15.104:0/261324243 >> 172.21.15.104:0/261324243 conn(0x7fe03c09d830 msgr2=0x7fe03c0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 -- 172.21.15.104:0/261324243 shutdown_connections 2024-09-17T04:09:54.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.919+0000 7fe042440640 1 -- 172.21.15.104:0/261324243 wait complete. 2024-09-17T04:09:54.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.920+0000 7fe042440640 1 Processor -- start 2024-09-17T04:09:54.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.921+0000 7fe042440640 1 -- start start 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c0b9ad0 0x7fe03c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe03c15ee80 0x7fe03c1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0b6700 con 0x7fe03c0ceb90 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0b6580 con 0x7fe03c0b9ad0 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe042440640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0b6880 con 0x7fe03c15ee80 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55198/0 (socket says 172.21.15.104:55198) 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 -- 172.21.15.104:0/13999391 learned_addr learned my addr 172.21.15.104:0/13999391 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:54.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03bfff640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c0b9ad0 0x7fe03c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe0409dd640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe03c15ee80 0x7fe03c1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 -- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe03c15ee80 msgr2=0x7fe03c1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe03c15ee80 0x7fe03c1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 -- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c0b9ad0 msgr2=0x7fe03c06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c0b9ad0 0x7fe03c06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 -- 172.21.15.104:0/13999391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c0cb610 con 0x7fe03c0ceb90 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.922+0000 7fe03b7fe640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c470 tx=0x7fe03000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.923+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030017070 con 0x7fe03c0ceb90 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.923+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0300053c0 con 0x7fe03c0ceb90 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.923+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0300038a0 con 0x7fe03c0ceb90 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.923+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c0cb8f0 con 0x7fe03c0ceb90 2024-09-17T04:09:54.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.923+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c0cbeb0 con 0x7fe03c0ceb90 2024-09-17T04:09:54.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.924+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c0d2120 con 0x7fe03c0ceb90 2024-09-17T04:09:54.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.925+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe03001a070 con 0x7fe03c0ceb90 2024-09-17T04:09:54.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.925+0000 7fe038ff9640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 0x7fe02807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:54.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.925+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe03009a330 con 0x7fe03c0ceb90 2024-09-17T04:09:54.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.925+0000 7fe03bfff640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 0x7fe02807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:54.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.926+0000 7fe03bfff640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 0x7fe02807b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe02c033000 tx=0x7fe02c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:54.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:54.930+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe03c0d2120 con 0x7fe03c0ceb90 2024-09-17T04:09:55.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.105+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe03c06f520 con 0x7fe03c0ceb90 2024-09-17T04:09:55.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.105+0000 7fe038ff9640 1 -- 172.21.15.104:0/13999391 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7fe03c1592d0 con 0x7fe03c0ceb90 2024-09-17T04:09:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:55.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 msgr2=0x7fe02807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 0x7fe02807b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe02c033000 tx=0x7fe02c004730 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 msgr2=0x7fe03c14f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe03000c470 tx=0x7fe03000c930 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 shutdown_connections 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe028078b90 0x7fe02807b0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe03c15ee80 0x7fe03c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe03c0ceb90 0x7fe03c14f540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.107+0000 7fe042440640 1 --2- 172.21.15.104:0/13999391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c0b9ad0 0x7fe03c06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.108+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 >> 172.21.15.104:0/13999391 conn(0x7fe03c09d830 msgr2=0x7fe03c1616b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.108+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 shutdown_connections 2024-09-17T04:09:55.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.108+0000 7fe042440640 1 -- 172.21.15.104:0/13999391 wait complete. 2024-09-17T04:09:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:[{"version":31,"timestamp":"2024-09-17T04:09:27.689347+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5137.633775"}]}] 2024-09-17T04:09:55.119 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T04:09:55.119 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T04:09:55.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T04:09:55.119 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.230+0000 7f3fde625640 1 -- 172.21.15.104:0/2046193339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 msgr2=0x7f3fd80d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.230+0000 7f3fde625640 1 --2- 172.21.15.104:0/2046193339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd80d04c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0005fd0 tx=0x7f3fd002aaa0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.230+0000 7f3fde625640 1 -- 172.21.15.104:0/2046193339 shutdown_connections 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.230+0000 7f3fde625640 1 --2- 172.21.15.104:0/2046193339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd80d04c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.230+0000 7f3fde625640 1 --2- 172.21.15.104:0/2046193339 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd80d1ed0 0x7f3fd80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.231+0000 7f3fde625640 1 -- 172.21.15.104:0/2046193339 >> 172.21.15.104:0/2046193339 conn(0x7f3fd80cef40 msgr2=0x7f3fd80cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.231+0000 7f3fde625640 1 -- 172.21.15.104:0/2046193339 shutdown_connections 2024-09-17T04:09:55.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.231+0000 7f3fde625640 1 -- 172.21.15.104:0/2046193339 wait complete. 2024-09-17T04:09:55.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.232+0000 7f3fde625640 1 Processor -- start 2024-09-17T04:09:55.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.233+0000 7f3fde625640 1 -- start start 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fd80d1ed0 0x7f3fd814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 0x7f3fd815b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80d0d90 con 0x7f3fd80cce70 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd80d0c10 con 0x7f3fd80d1ed0 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fde625640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd80d0f10 con 0x7f3fd81536e0 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55212/0 (socket says 172.21.15.104:55212) 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 -- 172.21.15.104:0/1930992809 learned_addr learned my addr 172.21.15.104:0/1930992809 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd77fe640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fd80d1ed0 0x7f3fd814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fdcbc2640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 0x7f3fd815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 -- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 msgr2=0x7f3fd815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 0x7f3fd815b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 -- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fd80d1ed0 msgr2=0x7f3fd814caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fd80d1ed0 0x7f3fd814caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 -- 172.21.15.104:0/1930992809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd814cfe0 con 0x7f3fd80cce70 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fdcbc2640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 0x7f3fd815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd7fff640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c3a0 tx=0x7f3fc800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.234+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8017070 con 0x7f3fd80cce70 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.235+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fc80053c0 con 0x7f3fd80cce70 2024-09-17T04:09:55.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.235+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd81f58b0 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.235+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8003850 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.235+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd81f5e70 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.236+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd80d00c0 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.236+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fc801a070 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.237+0000 7f3fd4ff9640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.237+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3fc809a2f0 con 0x7f3fd80cce70 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.237+0000 7f3fd77fe640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.238+0000 7f3fd77fe640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 0x7f3fc407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fd81efaf0 tx=0x7f3fcc00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.241+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3fd80d00c0 con 0x7f3fd80cce70 2024-09-17T04:09:55.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.464+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3fd80d04c0 con 0x7f3fd80cce70 2024-09-17T04:09:55.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.467+0000 7f3fd4ff9640 1 -- 172.21.15.104:0/1930992809 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194719 (secure 0 0 0) 0x7f3fd80cd280 con 0x7f3fd80cce70 2024-09-17T04:09:55.469 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:55.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 msgr2=0x7f3fc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 0x7f3fc407b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fd81efaf0 tx=0x7f3fcc00a250 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 msgr2=0x7f3fd81e8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c3a0 tx=0x7f3fc800c860 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 shutdown_connections 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fd80d1ed0 0x7f3fd814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fd81536e0 0x7f3fd815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 --2- 172.21.15.104:0/1930992809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd80cce70 0x7f3fd81e8420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 >> 172.21.15.104:0/1930992809 conn(0x7f3fd80cef40 msgr2=0x7f3fd80711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 shutdown_connections 2024-09-17T04:09:55.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.470+0000 7f3fde625640 1 -- 172.21.15.104:0/1930992809 wait complete. 2024-09-17T04:09:55.481 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":330081550},{"type":"v1","addr":"172.21.15.192:6801","nonce":330081550}]},"active_addr":"172.21.15.192:6801/330081550","active_change":"2024-09-17T04:09:19.330514+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3445125291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1372848068}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2328019150}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":4086423489}]}]} 2024-09-17T04:09:55.485 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T04:09:55.486 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T04:09:55.486 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:55.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 -- 172.21.15.104:0/2513312235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafa4004d40 msgr2=0x7fafa4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/2513312235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafa4004d40 0x7fafa4005150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fafb0005fd0 tx=0x7fafa4005830 comp rx=0 tx=0).stop 2024-09-17T04:09:55.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafb6d9d640 1 -- 172.21.15.104:0/2513312235 reap_dead start 2024-09-17T04:09:55.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 -- 172.21.15.104:0/2513312235 shutdown_connections 2024-09-17T04:09:55.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 -- 172.21.15.104:0/2513312235 >> 172.21.15.104:0/2513312235 conn(0x7fafb80b6b20 msgr2=0x7fafb80d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 -- 172.21.15.104:0/2513312235 shutdown_connections 2024-09-17T04:09:55.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.597+0000 7fafbcbe4640 1 -- 172.21.15.104:0/2513312235 wait complete. 2024-09-17T04:09:55.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.599+0000 7fafbcbe4640 1 Processor -- start 2024-09-17T04:09:55.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.599+0000 7fafbcbe4640 1 -- start start 2024-09-17T04:09:55.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafa4004d40 0x7fafb80cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb814cf10 0x7fafb81f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8162690 con 0x7fafb814c160 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80b39a0 con 0x7fafb814cf10 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fafb8162810 con 0x7fafa4004d40 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55224/0 (socket says 172.21.15.104:55224) 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 -- 172.21.15.104:0/1749462182 learned_addr learned my addr 172.21.15.104:0/1749462182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafb659c640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafa4004d40 0x7fafb80cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafb6d9d640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb814cf10 0x7fafb81f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 -- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafa4004d40 msgr2=0x7fafb80cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafa4004d40 0x7fafb80cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 -- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb814cf10 msgr2=0x7fafb81f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb814cf10 0x7fafb81f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 -- 172.21.15.104:0/1749462182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb814d320 con 0x7fafb814c160 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafadd9b640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fafa00118a0 tx=0x7fafa0011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa001e070 con 0x7fafb814c160 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafa000fd50 con 0x7fafb814c160 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0019690 con 0x7fafb814c160 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.601+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb80c9ba0 con 0x7fafb814c160 2024-09-17T04:09:55.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.602+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb80ca160 con 0x7fafb814c160 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.602+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8162f00 con 0x7fafb814c160 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.603+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafa0021070 con 0x7fafb814c160 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.604+0000 7fafaf7fe640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 0x7faf9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.604+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fafa009bac0 con 0x7fafb814c160 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.604+0000 7fafb659c640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 0x7faf9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.604+0000 7fafb659c640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 0x7faf9807b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafa8006fd0 tx=0x7fafa8006da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.608+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafa0063630 con 0x7fafb814c160 2024-09-17T04:09:55.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.783+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafb8161dd0 con 0x7fafb814c160 2024-09-17T04:09:55.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.784+0000 7fafaf7fe640 1 -- 172.21.15.104:0/1749462182 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7fafa0068060 con 0x7fafb814c160 2024-09-17T04:09:55.784 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:55.785 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:55.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 msgr2=0x7faf9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 0x7faf9807b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafa8006fd0 tx=0x7fafa8006da0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 msgr2=0x7fafb814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fafa00118a0 tx=0x7fafa0011ca0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 shutdown_connections 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faf98078b90 0x7faf9807b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb814cf10 0x7fafb81f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafb814c160 0x7fafb814c9d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.786+0000 7fafbcbe4640 1 --2- 172.21.15.104:0/1749462182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafa4004d40 0x7fafb80cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.787+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 >> 172.21.15.104:0/1749462182 conn(0x7fafb80b6b20 msgr2=0x7fafb8068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.787+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 shutdown_connections 2024-09-17T04:09:55.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.787+0000 7fafbcbe4640 1 -- 172.21.15.104:0/1749462182 wait complete. 2024-09-17T04:09:55.798 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T04:09:55.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 -- 172.21.15.104:0/1253717258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d40162f00 msgr2=0x7f8d400d24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/1253717258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d40162f00 0x7f8d400d24d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d400b7460 tx=0x7f8d3002a4d0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 -- 172.21.15.104:0/1253717258 shutdown_connections 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/1253717258 >> v2:172.21.15.192:3300/0 conn(0x7f8d40162280 0x7f8d40162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/1253717258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d40162f00 0x7f8d400d24d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 -- 172.21.15.104:0/1253717258 >> 172.21.15.104:0/1253717258 conn(0x7f8d400b6b20 msgr2=0x7f8d400d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 -- 172.21.15.104:0/1253717258 shutdown_connections 2024-09-17T04:09:55.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.911+0000 7f8d45c0e640 1 -- 172.21.15.104:0/1253717258 wait complete. 2024-09-17T04:09:55.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.912+0000 7f8d45c0e640 1 Processor -- start 2024-09-17T04:09:55.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.913+0000 7f8d45c0e640 1 -- start start 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d400b2e40 0x7f8d4014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d40162280 0x7f8d400ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4015e630 con 0x7f8d400b1840 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4015e4b0 con 0x7f8d40162280 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d45c0e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4015e7b0 con 0x7f8d400b2e40 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55238/0 (socket says 172.21.15.104:55238) 2024-09-17T04:09:55.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 -- 172.21.15.104:0/2349538435 learned_addr learned my addr 172.21.15.104:0/2349538435 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3f7fe640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d400b2e40 0x7f8d4014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3effd640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d40162280 0x7f8d400ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 -- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d400b2e40 msgr2=0x7f8d4014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d400b2e40 0x7f8d4014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 -- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d40162280 msgr2=0x7f8d400ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d40162280 0x7f8d400ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.914+0000 7f8d3ffff640 1 -- 172.21.15.104:0/2349538435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d400b1fb0 con 0x7f8d400b1840 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d3ffff640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800ba10 tx=0x7f8d3800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38019070 con 0x7f8d400b1840 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d3800cc30 con 0x7f8d400b1840 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800ce60 con 0x7f8d400b1840 2024-09-17T04:09:55.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400b2290 con 0x7f8d400b1840 2024-09-17T04:09:55.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.915+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d400b2850 con 0x7f8d400b1840 2024-09-17T04:09:55.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.916+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40162f00 con 0x7f8d400b1840 2024-09-17T04:09:55.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.916+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d3801c070 con 0x7f8d400b1840 2024-09-17T04:09:55.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.917+0000 7f8d27fff640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 0x7f8d2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:55.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.917+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8d3809ab50 con 0x7f8d400b1840 2024-09-17T04:09:55.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.917+0000 7f8d3f7fe640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 0x7f8d2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:55.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.917+0000 7f8d3f7fe640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 0x7f8d2c07b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d30033000 tx=0x7f8d30004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:55.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:55.921+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d38062d70 con 0x7f8d400b1840 2024-09-17T04:09:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.095+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d400b3250 con 0x7f8d400b1840 2024-09-17T04:09:56.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.096+0000 7f8d27fff640 1 -- 172.21.15.104:0/2349538435 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7f8d38062670 con 0x7f8d400b1840 2024-09-17T04:09:56.096 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:56.096 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 msgr2=0x7f8d2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 0x7f8d2c07b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d30033000 tx=0x7f8d30004730 comp rx=0 tx=0).stop 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 msgr2=0x7f8d401f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800ba10 tx=0x7f8d3800bed0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 shutdown_connections 2024-09-17T04:09:56.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8d2c078bc0 0x7f8d2c07b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d40162280 0x7f8d400ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d400b1840 0x7f8d401f5080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 --2- 172.21.15.104:0/2349538435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d400b2e40 0x7f8d4014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 >> 172.21.15.104:0/2349538435 conn(0x7f8d400b6b20 msgr2=0x7f8d4015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 shutdown_connections 2024-09-17T04:09:56.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.098+0000 7f8d45c0e640 1 -- 172.21.15.104:0/2349538435 wait complete. 2024-09-17T04:09:56.110 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T04:09:56.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T04:09:56.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T04:09:56.111 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T04:09:56.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T04:09:56.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T04:09:56.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T04:09:56.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T04:09:56.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.325+0000 7fab4f68b640 1 -- 172.21.15.104:0/1629789359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab48073000 msgr2=0x7fab480cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.325+0000 7fab4f68b640 1 --2- 172.21.15.104:0/1629789359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab48073000 0x7fab480cc160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab44009820 tx=0x7fab4402a500 comp rx=0 tx=0).stop 2024-09-17T04:09:56.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 -- 172.21.15.104:0/1629789359 shutdown_connections 2024-09-17T04:09:56.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 --2- 172.21.15.104:0/1629789359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cfac0 0x7fab48162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 --2- 172.21.15.104:0/1629789359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab48073000 0x7fab480cc160 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 -- 172.21.15.104:0/1629789359 >> 172.21.15.104:0/1629789359 conn(0x7fab480b1b90 msgr2=0x7fab480b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 -- 172.21.15.104:0/1629789359 shutdown_connections 2024-09-17T04:09:56.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.326+0000 7fab4f68b640 1 -- 172.21.15.104:0/1629789359 wait complete. 2024-09-17T04:09:56.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.328+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2555575257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 msgr2=0x7f3cac034400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.328+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2555575257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac034400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0372b0 tx=0x7f3cb002a060 comp rx=0 tx=0).stop 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2555575257 shutdown_connections 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2555575257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac050fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2555575257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac034400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2555575257 >> 172.21.15.104:0/2555575257 conn(0x7f3cac01d9a0 msgr2=0x7f3cac039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2555575257 shutdown_connections 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2555575257 wait complete. 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7fab4f68b640 1 Processor -- start 2024-09-17T04:09:56.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7fab4f68b640 1 -- start start 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 -- 172.21.15.104:0/3434502095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c00cf9a0 msgr2=0x7f27c0072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 --2- 172.21.15.104:0/3434502095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c00cf9a0 0x7f27c0072d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f27b8005fd0 tx=0x7f27b802ea30 comp rx=0 tx=0).stop 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2211695653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a38005c60 msgr2=0x7f2a38006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 -- 172.21.15.104:0/3434502095 shutdown_connections 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 --2- 172.21.15.104:0/3434502095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c00cf9a0 0x7f27c0072d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 --2- 172.21.15.104:0/3434502095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c015fc50 0x7f27c006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f27c5420640 1 -- 172.21.15.104:0/3434502095 >> 172.21.15.104:0/3434502095 conn(0x7f27c00b1b90 msgr2=0x7f27c00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2211695653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a38005c60 0x7f2a38006660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a40000b60 tx=0x7f2a400a7050 comp rx=0 tx=0).stop 2024-09-17T04:09:56.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2211695653 shutdown_connections 2024-09-17T04:09:56.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2211695653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a38005c60 0x7f2a38006660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2211695653 >> v2:172.21.15.104:3300/0 conn(0x7f2a38036b40 0x7f2a380df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.329+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2211695653 >> 172.21.15.104:0/2211695653 conn(0x7f2a38051420 msgr2=0x7f2a38051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f27c5420640 1 -- 172.21.15.104:0/3434502095 shutdown_connections 2024-09-17T04:09:56.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f27c5420640 1 -- 172.21.15.104:0/3434502095 wait complete. 2024-09-17T04:09:56.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2211695653 shutdown_connections 2024-09-17T04:09:56.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 -- 172.21.15.104:0/4158632921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714009f60 msgr2=0x7f4714006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 --2- 172.21.15.104:0/4158632921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714009f60 0x7f4714006ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f470c0098e0 tx=0x7f470c02a520 comp rx=0 tx=0).stop 2024-09-17T04:09:56.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 -- 172.21.15.104:0/4158632921 shutdown_connections 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 --2- 172.21.15.104:0/4158632921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714036380 0x7f4714036790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 --2- 172.21.15.104:0/4158632921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714009f60 0x7f4714006ea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f4722b7d640 1 -- 172.21.15.104:0/4158632921 >> 172.21.15.104:0/4158632921 conn(0x7f4714051420 msgr2=0x7f4714051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.331+0000 7f4722b7d640 1 -- 172.21.15.104:0/4158632921 shutdown_connections 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.331+0000 7fab4f68b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 0x7fab4809f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.331+0000 7f4722b7d640 1 -- 172.21.15.104:0/4158632921 wait complete. 2024-09-17T04:09:56.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.330+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2211695653 wait complete. 2024-09-17T04:09:56.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7f3cbb2d0640 1 Processor -- start 2024-09-17T04:09:56.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7f3cbb2d0640 1 -- start start 2024-09-17T04:09:56.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7f1f91558640 1 -- 172.21.15.104:0/3296237038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c15c400 msgr2=0x7f1f8c160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7fab4f68b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cf6b0 0x7fab4809fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7fab4f68b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab480cfac0 0x7fab4809ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7fab4f68b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab48162d20 con 0x7fab48073000 2024-09-17T04:09:56.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7fab4f68b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fab48162ba0 con 0x7fab480cfac0 2024-09-17T04:09:56.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7fab4f68b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fab4806ddf0 con 0x7fab480cf6b0 2024-09-17T04:09:56.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fab4d427640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 0x7fab4809f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.332+0000 7f1f91558640 1 --2- 172.21.15.104:0/3296237038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c15c400 0x7f1f8c160980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009bb0 tx=0x7f1f8402a8d0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f2a3f59e640 1 Processor -- start 2024-09-17T04:09:56.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fab4d427640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 0x7fab4809f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55290/0 (socket says 172.21.15.104:55290) 2024-09-17T04:09:56.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fab4d427640 1 -- 172.21.15.104:0/2493611752 learned_addr learned my addr 172.21.15.104:0/2493611752 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f2a3f59e640 1 -- start start 2024-09-17T04:09:56.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f9396e97640 1 -- 172.21.15.104:0/636234216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f939015f6d0 msgr2=0x7f939015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f9396e97640 1 --2- 172.21.15.104:0/636234216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f939015f6d0 0x7f939015e3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f938c005fd0 tx=0x7f938c02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fab4cc26640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cf6b0 0x7fab4809fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fab4d427640 1 -- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cf6b0 msgr2=0x7fab4809fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f27c5420640 1 Processor -- start 2024-09-17T04:09:56.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f27c5420640 1 -- start start 2024-09-17T04:09:56.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fccfc29b640 1 -- 172.21.15.104:0/1157410071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf415b730 msgr2=0x7fccf40b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7fccfc29b640 1 --2- 172.21.15.104:0/1157410071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf415b730 0x7fccf40b5d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009830 tx=0x7fccf002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f4722b7d640 1 Processor -- start 2024-09-17T04:09:56.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fab4d427640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cf6b0 0x7fab4809fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 -- 172.21.15.104:0/636234216 shutdown_connections 2024-09-17T04:09:56.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 --2- 172.21.15.104:0/636234216 >> v2:172.21.15.104:3300/0 conn(0x7f93900d2290 0x7f93900d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 --2- 172.21.15.104:0/636234216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f939015f6d0 0x7f939015e3d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 -- 172.21.15.104:0/1157410071 shutdown_connections 2024-09-17T04:09:56.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 --2- 172.21.15.104:0/1157410071 >> v2:172.21.15.192:3300/0 conn(0x7fccf40b6290 0x7fccf40caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 -- 172.21.15.104:0/636234216 >> 172.21.15.104:0/636234216 conn(0x7f93900d41e0 msgr2=0x7f93900d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 --2- 172.21.15.104:0/1157410071 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf415b730 0x7fccf40b5d20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 -- 172.21.15.104:0/1157410071 >> 172.21.15.104:0/1157410071 conn(0x7fccf40735d0 msgr2=0x7fccf40739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fab4d427640 1 -- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab480cfac0 msgr2=0x7fab4809ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 -- 172.21.15.104:0/1157410071 shutdown_connections 2024-09-17T04:09:56.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fab4d427640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab480cfac0 0x7fab4809ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fccfc29b640 1 -- 172.21.15.104:0/1157410071 wait complete. 2024-09-17T04:09:56.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fab4d427640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab480a04f0 con 0x7fab48073000 2024-09-17T04:09:56.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7fab4cc26640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab480cf6b0 0x7fab4809fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:56.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cbb2d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cac031290 0x7f3cac0215d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 -- 172.21.15.104:0/636234216 shutdown_connections 2024-09-17T04:09:56.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f9396e97640 1 -- 172.21.15.104:0/636234216 wait complete. 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cbb2d0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac0dd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cbb2d0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac16c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f1f91558640 1 -- 172.21.15.104:0/3296237038 shutdown_connections 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f1f91558640 1 --2- 172.21.15.104:0/3296237038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c15c400 0x7f1f8c160980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f1f91558640 1 -- 172.21.15.104:0/3296237038 >> 172.21.15.104:0/3296237038 conn(0x7f1f8c0731e0 msgr2=0x7f1f8c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f1f91558640 1 -- 172.21.15.104:0/3296237038 shutdown_connections 2024-09-17T04:09:56.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.333+0000 7f1f91558640 1 -- 172.21.15.104:0/3296237038 wait complete. 2024-09-17T04:09:56.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cba2ce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cac031290 0x7f3cac0215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cba2ce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cac031290 0x7f3cac0215d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:39480/0 (socket says 172.21.15.104:39480) 2024-09-17T04:09:56.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cb9acd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac0dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cb9acd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac0dd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:44378/0 (socket says 172.21.15.104:44378) 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cbaacf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac16c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f3cbaacf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac16c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55292/0 (socket says 172.21.15.104:55292) 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cba2ce640 1 -- 172.21.15.104:0/2512346683 learned_addr learned my addr 172.21.15.104:0/2512346683 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac039d70 con 0x7f3cac0df3b0 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.334+0000 7f4722b7d640 1 -- start start 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac039ef0 con 0x7f3cac031290 2024-09-17T04:09:56.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac0514f0 con 0x7f3cac0316a0 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27c006e330 0x7f27c01fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 0x7f27c01f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c015fc50 0x7f27c00a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00732d0 con 0x7f27c006e330 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00ca9a0 con 0x7f27c015fc50 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27c5420640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f27c0073450 con 0x7f27c00cf9a0 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27be7fc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 0x7f27c01f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27be7fc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 0x7f27c01f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:44394/0 (socket says 172.21.15.104:44394) 2024-09-17T04:09:56.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27be7fc640 1 -- 172.21.15.104:0/1729101558 learned_addr learned my addr 172.21.15.104:0/1729101558 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27bf7fe640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c015fc50 0x7f27c00a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f2a3f59e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 0x7f2a380e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f2a3f59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a38009ba0 0x7f2a380dabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f27beffd640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27c006e330 0x7f27c01fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 -- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c015fc50 msgr2=0x7f27c00a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c015fc50 0x7f27c00a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 -- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27c006e330 msgr2=0x7f27c01fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27c006e330 0x7f27c01fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c01fa8f0 con 0x7f27c00cf9a0 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3e59c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 0x7f2a380e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3e59c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 0x7f2a380e0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:44404/0 (socket says 172.21.15.104:44404) 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cb9acd640 1 -- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cac031290 msgr2=0x7f3cac0215d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cb9acd640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cac031290 0x7f3cac0215d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cb9acd640 1 -- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 msgr2=0x7f3cac16c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cb9acd640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac16c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a38009ba0 0x7f2a380dabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.335+0000 7f3cb9acd640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac021e20 con 0x7f3cac0316a0 2024-09-17T04:09:56.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3cbaacf640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac0df3b0 0x7f3cac16c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:56.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3cb9acd640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac0dd560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c440 tx=0x7f3ca400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27be7fc640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 0x7f27c01f0210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c430 tx=0x7f27b400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7fab4d427640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 0x7fab4809f600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab44009770 tx=0x7fab440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4017070 con 0x7f3cac0316a0 2024-09-17T04:09:56.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca40053c0 con 0x7f3cac0316a0 2024-09-17T04:09:56.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac022100 con 0x7f3cac0316a0 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3f59e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a380da140 0x7f2a380db120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3f59e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2a380e3ba0 con 0x7f2a38009ba0 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3e59c640 1 -- 172.21.15.104:0/2514189818 learned_addr learned my addr 172.21.15.104:0/2514189818 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3800be40 con 0x7f2a380da140 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3ed9d640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a380da140 0x7f2a380db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2a38006ba0 con 0x7f2a38005c60 2024-09-17T04:09:56.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44041070 con 0x7fab48073000 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab44003cb0 con 0x7fab48073000 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44041070 con 0x7fab48073000 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 0x7f4714047560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714036380 0x7f47140dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47140e0fc0 0x7f47140db150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f47140382e0 con 0x7f4714009f60 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4714038160 con 0x7f4714036380 2024-09-17T04:09:56.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4722b7d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4714038460 con 0x7f47140e0fc0 2024-09-17T04:09:56.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4721b7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 0x7f4714047560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4721b7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 0x7f4714047560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55322/0 (socket says 172.21.15.104:55322) 2024-09-17T04:09:56.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7f4721b7b640 1 -- 172.21.15.104:0/302056201 learned_addr learned my addr 172.21.15.104:0/302056201 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7fccfc29b640 1 Processor -- start 2024-09-17T04:09:56.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7fccfc29b640 1 -- start start 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4011790 con 0x7f27c00cf9a0 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27b4017070 con 0x7f27c00cf9a0 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4011ca0 con 0x7f27c00cf9a0 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003850 con 0x7f3cac0316a0 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac0ddd90 con 0x7f3cac0316a0 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 -- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47140e0fc0 msgr2=0x7f47140db150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:09:56.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47140e0fc0 0x7f47140db150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 -- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714036380 msgr2=0x7f47140dac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714036380 0x7f47140dac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714047aa0 con 0x7f4714009f60 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27c5420640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c00c70e0 con 0x7f27c00cf9a0 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.336+0000 7f27c5420640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c00c78f0 con 0x7f27c00cf9a0 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f27c5420640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27a0001030 con 0x7f27c00cf9a0 2024-09-17T04:09:56.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cac022340 con 0x7f3cac0316a0 2024-09-17T04:09:56.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7fab4f68b640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab480a07d0 con 0x7fab48073000 2024-09-17T04:09:56.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.337+0000 7fab4f68b640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab48159330 con 0x7fab48073000 2024-09-17T04:09:56.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f9396e97640 1 Processor -- start 2024-09-17T04:09:56.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f9396e97640 1 -- start start 2024-09-17T04:09:56.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f4721b7b640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 0x7f4714047560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f470c02ab10 tx=0x7f470c004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.338+0000 7f1f91558640 1 Processor -- start 2024-09-17T04:09:56.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f1f91558640 1 -- start start 2024-09-17T04:09:56.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3e59c640 1 -- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a380da140 msgr2=0x7f2a380db120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ca401a070 con 0x7f3cac0316a0 2024-09-17T04:09:56.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3e59c640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a380da140 0x7f2a380db120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3e59c640 1 -- 172.21.15.104:0/2514189818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a38009ba0 msgr2=0x7f2a380dabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3e59c640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a38009ba0 0x7f2a380dabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3e59c640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380dd110 con 0x7f2a38005c60 2024-09-17T04:09:56.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f2a3dd9b640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a38009ba0 0x7f2a380dabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.339+0000 7f3caaffd640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3c98078be0 0x7f3c9807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3ca409a2f0 con 0x7f3cac0316a0 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f3caaffd640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f3c980823a0 0x7f3c98084830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ca4016ec0 con 0x7f3c980823a0 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3ca40a1050 con 0x7f3cac0316a0 2024-09-17T04:09:56.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f2a3e59c640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 0x7f2a380e0e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c3c0 tx=0x7f2a3000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7fab4f68b640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab28001030 con 0x7fab48073000 2024-09-17T04:09:56.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c031600 con 0x7f4714009f60 2024-09-17T04:09:56.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f3cbaacf640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f3c980823a0 0x7f3c98084830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47140e0a90 con 0x7f4714009f60 2024-09-17T04:09:56.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47140d7550 con 0x7f4714009f60 2024-09-17T04:09:56.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30017070 con 0x7f2a38005c60 2024-09-17T04:09:56.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f470c031ba0 con 0x7f4714009f60 2024-09-17T04:09:56.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0050c0 con 0x7f4714009f60 2024-09-17T04:09:56.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f9396e97640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 0x7f93901f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a300053c0 con 0x7f2a38005c60 2024-09-17T04:09:56.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.340+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a380dc350 con 0x7f2a38005c60 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c06d4f0 0x7f1f8c099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 0x7f1f8c09b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f8c15c400 0x7f1f8c09bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0d0f20 con 0x7f1f8c06d4f0 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0d0da0 con 0x7f1f8c0d0990 2024-09-17T04:09:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f1f91558640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0d10a0 con 0x7f1f8c15c400 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f9395e95640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 0x7f93901f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f9395e95640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 0x7f93901f8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:44426/0 (socket says 172.21.15.104:44426) 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f9395e95640 1 -- 172.21.15.104:0/4282421180 learned_addr learned my addr 172.21.15.104:0/4282421180 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93900d2290 0x7f93900ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f939015f6d0 0x7f93900cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f9395694640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93900d2290 0x7f93900ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f3cbaacf640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f3c980823a0 0x7f3c98084830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f3cba2ce640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3c98078be0 0x7f3c9807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f3cba2ce640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3c98078be0 0x7f3c9807b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0005f10 tx=0x7f3cb002c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== osd.3 v2:172.21.15.104:6824/966144578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ca4016ec0 con 0x7f3c980823a0 2024-09-17T04:09:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f1f8a7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 0x7f1f8c09b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f1f8a7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 0x7f1f8c09b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:39514/0 (socket says 172.21.15.104:39514) 2024-09-17T04:09:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f1f8a7fc640 1 -- 172.21.15.104:0/84840268 learned_addr learned my addr 172.21.15.104:0/84840268 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f1f8b7fe640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f8c15c400 0x7f1f8c09bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccf406ddf0 0x7fccf4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf40b6290 0x7fccf414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 0x7fccf4152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4071820 con 0x7fccf415b730 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fccf40716a0 con 0x7fccf406ddf0 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfc29b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fccf40719a0 con 0x7fccf40b6290 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfa838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 0x7fccf4152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfa838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 0x7fccf4152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55330/0 (socket says 172.21.15.104:55330) 2024-09-17T04:09:56.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7fccfa838640 1 -- 172.21.15.104:0/1174513359 learned_addr learned my addr 172.21.15.104:0/1174513359 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93900d2d60 con 0x7f939015f6d0 2024-09-17T04:09:56.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93900d2be0 con 0x7f93900d2290 2024-09-17T04:09:56.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f93900d2ee0 con 0x7f93900cef00 2024-09-17T04:09:56.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 -- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f8c15c400 msgr2=0x7f1f8c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f8c15c400 0x7f1f8c09bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 -- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c06d4f0 msgr2=0x7f1f8c099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f8c06d4f0 0x7f1f8c099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c09e0b0 con 0x7f1f8c0d0990 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccf9836640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf40b6290 0x7fccf414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa037640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccf406ddf0 0x7fccf4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f8a7fc640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 0x7f1f8c09b730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000c370 tx=0x7f1f8000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.342+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27b401c460 con 0x7f27c00cf9a0 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa838640 1 -- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf40b6290 msgr2=0x7fccf414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa838640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccf40b6290 0x7fccf414fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa838640 1 -- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccf406ddf0 msgr2=0x7fccf4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa838640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccf406ddf0 0x7fccf4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7fccfa838640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf4156220 con 0x7fccf415b730 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80017070 con 0x7f1f8c0d0990 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f800035f0 con 0x7f1f8c0d0990 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80003a40 con 0x7f1f8c0d0990 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9395e95640 1 -- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93900d2290 msgr2=0x7f93900ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9395e95640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93900d2290 0x7f93900ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9395e95640 1 -- 172.21.15.104:0/4282421180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f939015f6d0 msgr2=0x7f93900cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9395e95640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f939015f6d0 0x7f93900cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f9395e95640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93901f5500 con 0x7f93900cef00 2024-09-17T04:09:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7fccfa838640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 0x7fccf4152ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cb40 tx=0x7fccec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27a77fe640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f27ac078b90 0x7f27ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c203a60 con 0x7f1f8c0d0990 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c09ddd0 con 0x7f1f8c0d0990 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f27b409b790 con 0x7f27c00cf9a0 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27beffd640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f27ac078b90 0x7f27ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27a77fe640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7f27ac082350 0x7f27ac0847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27ac084eb0 con 0x7f27ac082350 2024-09-17T04:09:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27b409bb80 con 0x7f27c00cf9a0 2024-09-17T04:09:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f9395e95640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 0x7f93901f8e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f938c033040 tx=0x7f938c004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f470c005260 con 0x7f4714009f60 2024-09-17T04:09:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4704001030 con 0x7f4714009f60 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c041070 con 0x7f93900cef00 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93901f57e0 con 0x7f93900cef00 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938c031940 con 0x7f93900cef00 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c031d50 con 0x7f93900cef00 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901f5da0 con 0x7f93900cef00 2024-09-17T04:09:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f8c203430 con 0x7f1f8c0d0990 2024-09-17T04:09:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f27bf7fe640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7f27ac082350 0x7f27ac0847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f27bf7fe640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7f27ac082350 0x7f27ac0847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f27beffd640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f27ac078b90 0x7f27ac07b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b0005fd0 tx=0x7f27b0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f47127fc640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4700078c90 0x7f470007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab44039040 con 0x7fab48073000 2024-09-17T04:09:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f470c0bc320 con 0x7f4714009f60 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30003850 con 0x7f2a38005c60 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.341+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a380dc910 con 0x7f2a38005c60 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.343+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a3001a070 con 0x7f2a38005c60 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f2a2effd640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2a20078bc0 0x7f2a2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.344+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2a3009a5c0 con 0x7f2a38005c60 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f2a38034cf0 0x7f2a38179ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.345+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a380e1370 con 0x7f2a38034cf0 2024-09-17T04:09:56.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f472137a640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4700078c90 0x7f470007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f2a3ed9d640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f2a38034cf0 0x7f2a38179ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f47127fc640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f4700082350 0x7f47000847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f470c004470 con 0x7f4700082350 2024-09-17T04:09:56.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec016020 con 0x7fccf415b730 2024-09-17T04:09:56.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccec00adb0 con 0x7fccf415b730 2024-09-17T04:09:56.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fccfc29b640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf41553d0 con 0x7fccf415b730 2024-09-17T04:09:56.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec012680 con 0x7fccf415b730 2024-09-17T04:09:56.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fab3dffb640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fab2c078fc0 0x7fab2c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7f2a3ed9d640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f2a38034cf0 0x7f2a38179ed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.346+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fab440039c0 con 0x7fab48073000 2024-09-17T04:09:56.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7f472237c640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f4700082350 0x7f47000847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7fab3dffb640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7fab2c082690 0x7fab2c084b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab44005640 con 0x7fab2c082690 2024-09-17T04:09:56.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== osd.1 v2:172.21.15.104:6800/2753114801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27ac084eb0 con 0x7f27ac082350 2024-09-17T04:09:56.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f8001a070 con 0x7f1f8c0d0990 2024-09-17T04:09:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f470c0803e0 con 0x7f4714009f60 2024-09-17T04:09:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f472237c640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f4700082350 0x7f47000847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7fccfc29b640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf4154b30 con 0x7fccf415b730 2024-09-17T04:09:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== osd.4 v2:172.21.15.192:6826/4212015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a380e1370 con 0x7f2a38034cf0 2024-09-17T04:09:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f938c044070 con 0x7f93900cef00 2024-09-17T04:09:56.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f472137a640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4700078c90 0x7f470007b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4714051a90 tx=0x7f4718006b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== osd.5 v2:172.21.15.192:6810/4207743842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f470c004470 con 0x7f4700082350 2024-09-17T04:09:56.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.347+0000 7fab4dc28640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7fab2c082690 0x7fab2c084b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fab440c2050 con 0x7fab48073000 2024-09-17T04:09:56.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f93867fc640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9374078b90 0x7f937407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f938c0bbfc0 con 0x7f93900cef00 2024-09-17T04:09:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f9395694640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9374078b90 0x7f937407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f1f737fe640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1f78078c60 0x7f1f7807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.348+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1f8009a2f0 con 0x7f1f8c0d0990 2024-09-17T04:09:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f2a3dd9b640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2a20078bc0 0x7f2a2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7fab4cc26640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fab2c078fc0 0x7fab2c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f1f737fe640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f1f780823a0 0x7f1f78084830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f1f8affd640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1f78078c60 0x7f1f7807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f80008e50 con 0x7f1f780823a0 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f800a1050 con 0x7f1f8c0d0990 2024-09-17T04:09:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7f93901f9390 0x7f93900cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93901f6110 con 0x7f93901f9390 2024-09-17T04:09:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.349+0000 7f9396696640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7f93901f9390 0x7f93900cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7f1f8affd640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1f78078c60 0x7f1f7807b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c06ae60 tx=0x7f1f84004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7f2a3dd9b640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2a20078bc0 0x7f2a2007b0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a380dd860 tx=0x7f2a3400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7f9395694640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9374078b90 0x7f937407b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9380007fd0 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7f1f8b7fe640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f1f780823a0 0x7f1f78084830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7f9396696640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7f93901f9390 0x7f93900cd460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.351+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== osd.6 v2:172.21.15.192:6818/1564224566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93901f6110 con 0x7f93901f9390 2024-09-17T04:09:56.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.351+0000 7f1f8b7fe640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f1f780823a0 0x7f1f78084830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccf4071ee0 con 0x7fccf415b730 2024-09-17T04:09:56.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccec019020 con 0x7fccf415b730 2024-09-17T04:09:56.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.351+0000 7fcceaffd640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fccd8078c90 0x7fccd807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.351+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fccec09b240 con 0x7fccf415b730 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.351+0000 7fccfa037640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fccd8078c90 0x7fccd807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fcceaffd640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fccd80823e0 0x7fccd8084870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccec019ec0 con 0x7fccd80823e0 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fccfa037640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fccd8078c90 0x7fccd807b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccf0034000 tx=0x7fccf0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fccf9836640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fccd80823e0 0x7fccd8084870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fccec05f300 con 0x7fccf415b730 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.350+0000 7fab4cc26640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fab2c078fc0 0x7fab2c07b4d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab480b2650 tx=0x7fab40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.352+0000 7fab4dc28640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7fab2c082690 0x7fab2c084b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.353+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== osd.2 v2:172.21.15.104:6816/812544585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab44005640 con 0x7fab2c082690 2024-09-17T04:09:56.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.353+0000 7fccf9836640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fccd80823e0 0x7fccd8084870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.353+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== osd.0 v2:172.21.15.104:6808/1713196558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f80008e50 con 0x7f1f780823a0 2024-09-17T04:09:56.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.354+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== osd.7 v2:172.21.15.192:6802/1452307488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccec019ec0 con 0x7fccd80823e0 2024-09-17T04:09:56.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.378+0000 7f27c5420640 1 -- 172.21.15.104:0/1729101558 --> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27a0002dd0 con 0x7f27ac082350 2024-09-17T04:09:56.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.378+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 --> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4704002dd0 con 0x7f4700082350 2024-09-17T04:09:56.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.379+0000 7f27a77fe640 1 -- 172.21.15.104:0/1729101558 <== osd.1 v2:172.21.15.104:6800/2753114801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27a0002dd0 con 0x7f27ac082350 2024-09-17T04:09:56.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.379+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 --> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3cac16c200 con 0x7f3c980823a0 2024-09-17T04:09:56.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f47127fc640 1 -- 172.21.15.104:0/302056201 <== osd.5 v2:172.21.15.192:6810/4207743842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4704002dd0 con 0x7f4700082350 2024-09-17T04:09:56.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f3caaffd640 1 -- 172.21.15.104:0/2512346683 <== osd.3 v2:172.21.15.104:6824/966144578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3cac16c200 con 0x7f3c980823a0 2024-09-17T04:09:56.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7f27ac082350 msgr2=0x7f27ac0847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7f27ac082350 0x7f27ac0847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f4700082350 msgr2=0x7f47000847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f27ac078b90 msgr2=0x7f27ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f4722b7d640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f4700082350 0x7f47000847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f27ac078b90 0x7f27ac07b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b0005fd0 tx=0x7f27b0005850 comp rx=0 tx=0).stop 2024-09-17T04:09:56.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 msgr2=0x7f27c01f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27a57fa640 1 --2- 172.21.15.104:0/1729101558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27c00cf9a0 0x7f27c01f0210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c430 tx=0x7f27b400c8f0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f27bf7fe640 1 -- 172.21.15.104:0/1729101558 reap_dead start 2024-09-17T04:09:56.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4700078c90 msgr2=0x7f470007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.380+0000 7f4722b7d640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f4700078c90 0x7f470007b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4714051a90 tx=0x7f4718006b50 comp rx=0 tx=0).stop 2024-09-17T04:09:56.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f3c980823a0 msgr2=0x7f3c98084830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 shutdown_connections 2024-09-17T04:09:56.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 msgr2=0x7f4714047560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 >> 172.21.15.104:0/1729101558 conn(0x7f27c00b1b90 msgr2=0x7f27c006f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f4722b7d640 1 --2- 172.21.15.104:0/302056201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4714009f60 0x7f4714047560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f470c02ab10 tx=0x7f470c004e30 comp rx=0 tx=0).stop 2024-09-17T04:09:56.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f472237c640 1 -- 172.21.15.104:0/302056201 reap_dead start 2024-09-17T04:09:56.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f3c980823a0 0x7f3c98084830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 shutdown_connections 2024-09-17T04:09:56.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f27a57fa640 1 -- 172.21.15.104:0/1729101558 wait complete. 2024-09-17T04:09:56.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 --> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a380552c0 con 0x7f2a38034cf0 2024-09-17T04:09:56.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3c98078be0 msgr2=0x7f3c9807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3c98078be0 0x7f3c9807b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0005f10 tx=0x7f3cb002c040 comp rx=0 tx=0).stop 2024-09-17T04:09:56.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 shutdown_connections 2024-09-17T04:09:56.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 >> 172.21.15.104:0/302056201 conn(0x7f4714051420 msgr2=0x7f4714054d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 msgr2=0x7f3cac0dd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.381+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 shutdown_connections 2024-09-17T04:09:56.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f4722b7d640 1 -- 172.21.15.104:0/302056201 wait complete. 2024-09-17T04:09:56.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 --2- 172.21.15.104:0/2512346683 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cac0316a0 0x7f3cac0dd560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c440 tx=0x7f3ca400c900 comp rx=0 tx=0).stop 2024-09-17T04:09:56.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbaacf640 1 -- 172.21.15.104:0/2512346683 reap_dead start 2024-09-17T04:09:56.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 shutdown_connections 2024-09-17T04:09:56.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 >> 172.21.15.104:0/2512346683 conn(0x7f3cac01d9a0 msgr2=0x7f3cac0333a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 --> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93900d3400 con 0x7f93901f9390 2024-09-17T04:09:56.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 shutdown_connections 2024-09-17T04:09:56.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f3cbb2d0640 1 -- 172.21.15.104:0/2512346683 wait complete. 2024-09-17T04:09:56.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f2a2effd640 1 -- 172.21.15.104:0/2514189818 <== osd.4 v2:172.21.15.192:6826/4212015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a380552c0 con 0x7f2a38034cf0 2024-09-17T04:09:56.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.382+0000 7f93867fc640 1 -- 172.21.15.104:0/4282421180 <== osd.6 v2:172.21.15.192:6818/1564224566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f93900d3400 con 0x7f93901f9390 2024-09-17T04:09:56.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 --> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f8c2031e0 con 0x7f1f780823a0 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f2a38034cf0 msgr2=0x7f2a38179ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f2a38034cf0 0x7f2a38179ed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2a20078bc0 msgr2=0x7f2a2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2a20078bc0 0x7f2a2007b0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a380dd860 tx=0x7f2a3400b2e0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 msgr2=0x7f2a380e0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 --2- 172.21.15.104:0/2514189818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a38005c60 0x7f2a380e0e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c3c0 tx=0x7f2a3000c880 comp rx=0 tx=0).stop 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3ed9d640 1 -- 172.21.15.104:0/2514189818 reap_dead start 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 shutdown_connections 2024-09-17T04:09:56.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 >> 172.21.15.104:0/2514189818 conn(0x7f2a38051420 msgr2=0x7f2a380e9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f1f737fe640 1 -- 172.21.15.104:0/84840268 <== osd.0 v2:172.21.15.104:6808/1713196558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f8c2031e0 con 0x7f1f780823a0 2024-09-17T04:09:56.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 shutdown_connections 2024-09-17T04:09:56.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.383+0000 7f2a3f59e640 1 -- 172.21.15.104:0/2514189818 wait complete. 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f1f780823a0 msgr2=0x7f1f78084830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f1f780823a0 0x7f1f78084830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1f78078c60 msgr2=0x7f1f7807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1f78078c60 0x7f1f7807b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c06ae60 tx=0x7f1f84004a40 comp rx=0 tx=0).stop 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 msgr2=0x7f1f8c09b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 --2- 172.21.15.104:0/84840268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f8c0d0990 0x7f1f8c09b730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000c370 tx=0x7f1f8000c830 comp rx=0 tx=0).stop 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f8b7fe640 1 -- 172.21.15.104:0/84840268 reap_dead start 2024-09-17T04:09:56.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 shutdown_connections 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 >> 172.21.15.104:0/84840268 conn(0x7f1f8c0731e0 msgr2=0x7f1f8c0ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 shutdown_connections 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f1f91558640 1 -- 172.21.15.104:0/84840268 wait complete. 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7f93901f9390 msgr2=0x7f93900cd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.384+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7f93901f9390 0x7f93900cd460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9374078b90 msgr2=0x7f937407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9374078b90 0x7f937407b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9380007fd0 tx=0x7f9380009040 comp rx=0 tx=0).stop 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 msgr2=0x7f93901f8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 --2- 172.21.15.104:0/4282421180 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93900cef00 0x7f93901f8e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f938c033040 tx=0x7f938c004260 comp rx=0 tx=0).stop 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396696640 1 -- 172.21.15.104:0/4282421180 reap_dead start 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 shutdown_connections 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 >> 172.21.15.104:0/4282421180 conn(0x7f93900d41e0 msgr2=0x7f939015d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 shutdown_connections 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7f9396e97640 1 -- 172.21.15.104:0/4282421180 wait complete. 2024-09-17T04:09:56.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 --> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccf40afc30 con 0x7fccd80823e0 2024-09-17T04:09:56.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.385+0000 7fab4f68b640 1 -- 172.21.15.104:0/2493611752 --> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab28002dd0 con 0x7fab2c082690 2024-09-17T04:09:56.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.386+0000 7fcceaffd640 1 -- 172.21.15.104:0/1174513359 <== osd.7 v2:172.21.15.192:6802/1452307488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccf40afc30 con 0x7fccd80823e0 2024-09-17T04:09:56.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.386+0000 7fab3dffb640 1 -- 172.21.15.104:0/2493611752 <== osd.2 v2:172.21.15.104:6816/812544585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab28002dd0 con 0x7fab2c082690 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.386+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7fab2c082690 msgr2=0x7fab2c084b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.386+0000 7fab337fe640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7fab2c082690 0x7fab2c084b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fab2c078fc0 msgr2=0x7fab2c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fab2c078fc0 0x7fab2c07b4d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab480b2650 tx=0x7fab40009040 comp rx=0 tx=0).stop 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 msgr2=0x7fab4809f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 --2- 172.21.15.104:0/2493611752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab48073000 0x7fab4809f600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab44009770 tx=0x7fab440045e0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab4dc28640 1 -- 172.21.15.104:0/2493611752 reap_dead start 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 shutdown_connections 2024-09-17T04:09:56.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 >> 172.21.15.104:0/2493611752 conn(0x7fab480b1b90 msgr2=0x7fab480aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fccd80823e0 msgr2=0x7fccd8084870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fcce8ff9640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fccd80823e0 0x7fccd8084870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 shutdown_connections 2024-09-17T04:09:56.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.387+0000 7fab337fe640 1 -- 172.21.15.104:0/2493611752 wait complete. 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fccd8078c90 msgr2=0x7fccd807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fccd8078c90 0x7fccd807b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fccf0034000 tx=0x7fccf0004730 comp rx=0 tx=0).stop 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 msgr2=0x7fccf4152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 --2- 172.21.15.104:0/1174513359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccf415b730 0x7fccf4152ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cb40 tx=0x7fccec00a060 comp rx=0 tx=0).stop 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fccfa838640 1 -- 172.21.15.104:0/1174513359 reap_dead start 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 shutdown_connections 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.388+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 >> 172.21.15.104:0/1174513359 conn(0x7fccf40735d0 msgr2=0x7fccf40ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.389+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 shutdown_connections 2024-09-17T04:09:56.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.389+0000 7fcce8ff9640 1 -- 172.21.15.104:0/1174513359 wait complete. 2024-09-17T04:09:56.419 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-09-17T04:09:56.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T04:09:56.421 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:56.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T04:09:56.423 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:56.423 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T04:09:56.424 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-09-17T04:09:56.424 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T04:09:56.425 INFO:teuthology.orchestra.run.smithi104.stdout:64424509450 2024-09-17T04:09:56.425 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T04:09:56.426 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:56.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T04:09:56.427 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:56.427 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T04:09:56.428 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:56.428 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T04:09:56.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc00e7fc640 1 -- 172.21.15.104:0/3552414311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000047a0 con 0x7fc0100b5260 2024-09-17T04:09:56.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 -- 172.21.15.104:0/3552414311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0100b5260 msgr2=0x7fc01015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 --2- 172.21.15.104:0/3552414311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0100b5260 0x7fc01015ba80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc010073190 tx=0x7fc00002a580 comp rx=0 tx=0).stop 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 -- 172.21.15.104:0/3552414311 shutdown_connections 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 --2- 172.21.15.104:0/3552414311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0100b5260 0x7fc01015ba80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 --2- 172.21.15.104:0/3552414311 >> v2:172.21.15.192:3300/0 conn(0x7fc01006def0 0x7fc01006f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.677+0000 7fc016215640 1 -- 172.21.15.104:0/3552414311 >> 172.21.15.104:0/3552414311 conn(0x7fc0100cdca0 msgr2=0x7fc0100ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 -- 172.21.15.104:0/1741262402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad1815bfc0 msgr2=0x7fad1815f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/1741262402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad1815bfc0 0x7fad1815f630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad180ced50 tx=0x7fad1002a8c0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 -- 172.21.15.104:0/1741262402 shutdown_connections 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/1741262402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad1815bfc0 0x7fad1815f630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/1741262402 >> v2:172.21.15.104:3300/0 conn(0x7fad180b5260 0x7fad1815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 -- 172.21.15.104:0/1741262402 >> 172.21.15.104:0/1741262402 conn(0x7fad180cdca0 msgr2=0x7fad180ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 -- 172.21.15.104:0/1741262402 shutdown_connections 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fad1e2d5640 1 -- 172.21.15.104:0/1741262402 wait complete. 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fc016215640 1 -- 172.21.15.104:0/3552414311 shutdown_connections 2024-09-17T04:09:56.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.678+0000 7fc016215640 1 -- 172.21.15.104:0/3552414311 wait complete. 2024-09-17T04:09:56.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 -- 172.21.15.104:0/1973901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 msgr2=0x7f92cc0d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 --2- 172.21.15.104:0/1973901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc0d0170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009830 tx=0x7f92c802a470 comp rx=0 tx=0).stop 2024-09-17T04:09:56.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 -- 172.21.15.104:0/1973901107 shutdown_connections 2024-09-17T04:09:56.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 --2- 172.21.15.104:0/1973901107 >> v2:172.21.15.192:3300/0 conn(0x7f92cc0ceb90 0x7f92cc0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 --2- 172.21.15.104:0/1973901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc0d0170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 -- 172.21.15.104:0/1973901107 >> 172.21.15.104:0/1973901107 conn(0x7f92cc09d830 msgr2=0x7f92cc0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 -- 172.21.15.104:0/1973901107 shutdown_connections 2024-09-17T04:09:56.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7f92d384d640 1 -- 172.21.15.104:0/1973901107 wait complete. 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.679+0000 7fb80d4a5640 1 -- 172.21.15.104:0/4188381857 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804005280 con 0x7fb800007d60 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 -- 172.21.15.104:0/4188381857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb800007d60 msgr2=0x7fb800050f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/4188381857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb800007d60 0x7fb800050f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 -- 172.21.15.104:0/4188381857 shutdown_connections 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/4188381857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb800008170 0x7fb800053610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/4188381857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb800007d60 0x7fb800050f90 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.680+0000 7fb80f4a9640 1 -- 172.21.15.104:0/4188381857 >> 172.21.15.104:0/4188381857 conn(0x7fb80001fbe0 msgr2=0x7fb800056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fc016215640 1 Processor -- start 2024-09-17T04:09:56.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fb80f4a9640 1 -- 172.21.15.104:0/4188381857 shutdown_connections 2024-09-17T04:09:56.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 -- 172.21.15.104:0/2361085550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09600706e0 msgr2=0x7f096015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 --2- 172.21.15.104:0/2361085550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09600706e0 0x7f096015e920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f095c005fd0 tx=0x7f095c02a5d0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fb80f4a9640 1 -- 172.21.15.104:0/4188381857 wait complete. 2024-09-17T04:09:56.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 -- 172.21.15.104:0/4081606400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54640ccc00 msgr2=0x7f546415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 --2- 172.21.15.104:0/4081606400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54640ccc00 0x7f546415e790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f546000af00 tx=0x7f5460032980 comp rx=0 tx=0).stop 2024-09-17T04:09:56.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fad1e2d5640 1 Processor -- start 2024-09-17T04:09:56.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 -- 172.21.15.104:0/2361085550 shutdown_connections 2024-09-17T04:09:56.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 --2- 172.21.15.104:0/2361085550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f096006ff00 0x7f0960070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 --2- 172.21.15.104:0/2361085550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09600706e0 0x7f096015e920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 -- 172.21.15.104:0/2361085550 >> 172.21.15.104:0/2361085550 conn(0x7f09600cdca0 msgr2=0x7f09600ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fad1e2d5640 1 -- start start 2024-09-17T04:09:56.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 -- 172.21.15.104:0/2361085550 shutdown_connections 2024-09-17T04:09:56.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f09677ed640 1 -- 172.21.15.104:0/2361085550 wait complete. 2024-09-17T04:09:56.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f32956ef640 1 -- 172.21.15.104:0/2527828079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32901628e0 msgr2=0x7f32900cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f32956ef640 1 --2- 172.21.15.104:0/2527828079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32901628e0 0x7f32900cf300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3284009860 tx=0x7f328402a510 comp rx=0 tx=0).stop 2024-09-17T04:09:56.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 -- 172.21.15.104:0/4081606400 shutdown_connections 2024-09-17T04:09:56.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 --2- 172.21.15.104:0/4081606400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54640ccc00 0x7f546415e790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f32956ef640 1 -- 172.21.15.104:0/2527828079 shutdown_connections 2024-09-17T04:09:56.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 --2- 172.21.15.104:0/4081606400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f546415b7a0 0x7f54640cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7f546b33f640 1 -- 172.21.15.104:0/4081606400 >> 172.21.15.104:0/4081606400 conn(0x7f546406f920 msgr2=0x7f54640b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f32956ef640 1 --2- 172.21.15.104:0/2527828079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32901628e0 0x7f32900cf300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f546b33f640 1 -- 172.21.15.104:0/4081606400 shutdown_connections 2024-09-17T04:09:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f32956ef640 1 -- 172.21.15.104:0/2527828079 >> 172.21.15.104:0/2527828079 conn(0x7f32900d1960 msgr2=0x7f32900d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f92d384d640 1 Processor -- start 2024-09-17T04:09:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f92d384d640 1 -- start start 2024-09-17T04:09:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f32956ef640 1 -- 172.21.15.104:0/2527828079 shutdown_connections 2024-09-17T04:09:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f32956ef640 1 -- 172.21.15.104:0/2527828079 wait complete. 2024-09-17T04:09:56.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.682+0000 7f546b33f640 1 -- 172.21.15.104:0/4081606400 wait complete. 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.681+0000 7fc016215640 1 -- start start 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.683+0000 7fc016215640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.683+0000 7fc016215640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0100b5260 0x7fc0100cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.683+0000 7fc00f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.683+0000 7fc00f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48940/0 (socket says 172.21.15.104:48940) 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.683+0000 7fc016215640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 0x7fc0100cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc00f7fe640 1 -- 172.21.15.104:0/4270398778 learned_addr learned my addr 172.21.15.104:0/4270398778 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad1e2d5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 0x7fad181517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad1e2d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 0x7fad180cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100b5a00 con 0x7fc01006def0 2024-09-17T04:09:56.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100b5880 con 0x7fc01015bfc0 2024-09-17T04:09:56.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc010071300 con 0x7fc0100b5260 2024-09-17T04:09:56.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fb80f4a9640 1 Processor -- start 2024-09-17T04:09:56.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fb80f4a9640 1 -- start start 2024-09-17T04:09:56.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7f92d384d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92cc0b9ad0 0x7f92cc1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad1e2d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad17fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 0x7fad181517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad17fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 0x7fad181517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60256/0 (socket says 172.21.15.104:60256) 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad177fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 0x7fad180cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad177fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 0x7fad180cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52244/0 (socket says 172.21.15.104:52244) 2024-09-17T04:09:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fad1c872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48950/0 (socket says 172.21.15.104:48950) 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad17fff640 1 -- 172.21.15.104:0/2099485095 learned_addr learned my addr 172.21.15.104:0/2099485095 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fad1815ff00 con 0x7fad1815bfc0 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad1815fd80 con 0x7fad180b5260 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fad18071300 con 0x7fad1806def0 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d384d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f546b33f640 1 Processor -- start 2024-09-17T04:09:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f546b33f640 1 -- start start 2024-09-17T04:09:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d384d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d384d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0b6700 con 0x7f92cc0ceb90 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d384d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc0b6580 con 0x7f92cc0b9ad0 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d384d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc0b6880 con 0x7f92cc15ee80 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48962/0 (socket says 172.21.15.104:48962) 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 -- 172.21.15.104:0/2668186840 learned_addr learned my addr 172.21.15.104:0/2668186840 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d1dea640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f09677ed640 1 Processor -- start 2024-09-17T04:09:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d15e9640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92cc0b9ad0 0x7f92cc1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f32956ef640 1 Processor -- start 2024-09-17T04:09:56.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 -- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 msgr2=0x7f92cc06e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc06e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 -- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92cc0b9ad0 msgr2=0x7f92cc1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92cc0b9ad0 0x7f92cc1543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f92d0de8640 1 -- 172.21.15.104:0/2668186840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc1f5880 con 0x7f92cc0ceb90 2024-09-17T04:09:56.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7f32956ef640 1 -- start start 2024-09-17T04:09:56.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7f09677ed640 1 -- start start 2024-09-17T04:09:56.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7f92d0de8640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c390 tx=0x7f92bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 -- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 msgr2=0x7fad181517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 0x7fad181517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 -- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 msgr2=0x7fad180cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 0x7fad180cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fad1c872640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1815aa60 con 0x7fad1815bfc0 2024-09-17T04:09:56.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fad1c872640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad10009000 tx=0x7fad10003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10031db0 con 0x7fad1815bfc0 2024-09-17T04:09:56.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1815ad40 con 0x7fad1815bfc0 2024-09-17T04:09:56.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1815b300 con 0x7fad1815bfc0 2024-09-17T04:09:56.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad10033160 con 0x7fad1815bfc0 2024-09-17T04:09:56.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc011790 con 0x7f92cc0ceb90 2024-09-17T04:09:56.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fb80f4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 0x7fb8000d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80f4a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 0x7fb80003a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 -- 172.21.15.104:0/2751281799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 msgr2=0x7f8af815f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 --2- 172.21.15.104:0/2751281799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af815f630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8af0005fd0 tx=0x7f8af002a9f0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 -- 172.21.15.104:0/2751281799 shutdown_connections 2024-09-17T04:09:56.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 --2- 172.21.15.104:0/2751281799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af815f630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 --2- 172.21.15.104:0/2751281799 >> v2:172.21.15.104:3300/0 conn(0x7f8af806def0 0x7f8af806f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f8aff407640 1 -- 172.21.15.104:0/2751281799 >> 172.21.15.104:0/2751281799 conn(0x7f8af80cdca0 msgr2=0x7f8af80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:56.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc1f5b60 con 0x7f92cc0ceb90 2024-09-17T04:09:56.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f546b33f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 0x7f5464155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f546b33f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80f4a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 0x7fb80003ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80dca6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 0x7fb80003a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80dca6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 0x7fb80003a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52260/0 (socket says 172.21.15.104:52260) 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80eca8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 0x7fb80003ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80eca8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 0x7fb80003ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60270/0 (socket says 172.21.15.104:60270) 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80eca8640 1 -- 172.21.15.104:0/526303853 learned_addr learned my addr 172.21.15.104:0/526303853 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb800053ee0 con 0x7fb800008170 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb800053d60 con 0x7fb8000514d0 2024-09-17T04:09:56.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb800037250 con 0x7fb8000e0e20 2024-09-17T04:09:56.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fb80e4a7640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 0x7fb8000d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7f546b33f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 0x7f54641f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc00ffff640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 0x7fc0100cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.684+0000 7fc00effd640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0100b5260 0x7fc0100cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fc00ffff640 1 -- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0100b5260 msgr2=0x7fc0100cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fc00ffff640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0100b5260 0x7fc0100cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.685+0000 7fc00ffff640 1 -- 172.21.15.104:0/4270398778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 msgr2=0x7fc0100cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fc00ffff640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fc00ffff640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc010158ef0 con 0x7fc01015bfc0 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.686+0000 7fc00ffff640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 0x7fc0100cca20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc00800bdd0 tx=0x7fc008009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008019070 con 0x7fc01015bfc0 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc008014440 con 0x7fc01015bfc0 2024-09-17T04:09:56.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.687+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0080148d0 con 0x7fc01015bfc0 2024-09-17T04:09:56.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc010156270 con 0x7fc01015bfc0 2024-09-17T04:09:56.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0100ccf60 con 0x7fc01015bfc0 2024-09-17T04:09:56.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92bc017070 con 0x7f92cc0ceb90 2024-09-17T04:09:56.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f09677ed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 0x7f09600cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f32956ef640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fc00f7fe640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f09677ed640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10033570 con 0x7fad1815bfc0 2024-09-17T04:09:56.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f32956ef640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32900cf840 0x7f329014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f09677ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0960071090 0x7f09601fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f0965589640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 0x7f09600cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fb80e4a7640 1 -- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 msgr2=0x7fb80003ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fb80e4a7640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 0x7fb80003ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f328ffff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fb80e4a7640 1 -- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 msgr2=0x7fb80003a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fb80e4a7640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 0x7fb80003a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7fb80e4a7640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8000e3db0 con 0x7fb800008170 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1f6120 con 0x7f92cc0ceb90 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f5469b3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f5469b3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52270/0 (socket says 172.21.15.104:52270) 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f546a33d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 0x7f5464155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f546ab3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 0x7f54641f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f546ab3e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 0x7f54641f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48976/0 (socket says 172.21.15.104:48976) 2024-09-17T04:09:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f5469b3c640 1 -- 172.21.15.104:0/1156682969 learned_addr learned my addr 172.21.15.104:0/1156682969 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5464070e70 con 0x7f546415ecd0 2024-09-17T04:09:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f328ffff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60298/0 (socket says 172.21.15.104:60298) 2024-09-17T04:09:56.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f32956ef640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f329015e500 0x7f329014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc011c80 con 0x7f92cc0ceb90 2024-09-17T04:09:56.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f328ffff640 1 -- 172.21.15.104:0/1235310475 learned_addr learned my addr 172.21.15.104:0/1235310475 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f32901555b0 con 0x7f32900cf840 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f3294eee640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f329015e500 0x7f329014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3290155730 con 0x7f329015e500 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f32901558b0 con 0x7f329006d2b0 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f328ffff640 1 -- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f329015e500 msgr2=0x7f329014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad10004040 con 0x7fad1815bfc0 2024-09-17T04:09:56.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f328ffff640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f329015e500 0x7f329014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5464070cf0 con 0x7f546415b7a0 2024-09-17T04:09:56.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f54640ce4d0 con 0x7f54640ccc00 2024-09-17T04:09:56.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f8aff407640 1 -- 172.21.15.104:0/2751281799 shutdown_connections 2024-09-17T04:09:56.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f328ffff640 1 -- 172.21.15.104:0/1235310475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32900cf840 msgr2=0x7f329014c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f328ffff640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32900cf840 0x7f329014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f328ffff640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3290158e70 con 0x7f329006d2b0 2024-09-17T04:09:56.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92bc01c460 con 0x7f92cc0ceb90 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f328ffff640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f328000c430 tx=0x7f328000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280017070 con 0x7f329006d2b0 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32800035f0 con 0x7f329006d2b0 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3290162a50 con 0x7f329006d2b0 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280003a80 con 0x7f329006d2b0 2024-09-17T04:09:56.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32900ca420 con 0x7f329006d2b0 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf8005290 con 0x7fad1815bfc0 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7fad14ff9640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 0x7fad0407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fad100bc710 con 0x7fad1815bfc0 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc00801c070 con 0x7fc01015bfc0 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7fbff7fff640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 0x7fbffc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc00809ad60 con 0x7fc01015bfc0 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f8aff407640 1 -- 172.21.15.104:0/2751281799 wait complete. 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f92c1ffb640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 0x7f92b007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f92d15e9640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 0x7f92b007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f5469b3c640 1 -- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 msgr2=0x7f5464155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f5469b3c640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 0x7f5464155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f5469b3c640 1 -- 172.21.15.104:0/1156682969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 msgr2=0x7f54641f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f5469b3c640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 0x7f54641f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f5469b3c640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5464153a80 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f546a33d640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 0x7f5464155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f5469b3c640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54600084c0 tx=0x7f5460004d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460047070 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f546000a2e0 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54641f2080 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54640a9850 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.692+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546000a6b0 con 0x7f546415b7a0 2024-09-17T04:09:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7fb80e4a7640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 0x7fb8000d5cb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb804004000 tx=0x7fb804005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f0965589640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 0x7f09600cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52280/0 (socket says 172.21.15.104:52280) 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f0964d88640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.688+0000 7f0964d88640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60300/0 (socket says 172.21.15.104:60300) 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f0965589640 1 -- 172.21.15.104:0/4094934639 learned_addr learned my addr 172.21.15.104:0/4094934639 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0960162bb0 con 0x7f0960071090 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0960070310 con 0x7f096006ff00 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.689+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0960162d30 con 0x7f09600706e0 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 -- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 msgr2=0x7f09600cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 0x7f09600cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0965d8a640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0960071090 0x7f09601fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 -- 172.21.15.104:0/4094934639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0960071090 msgr2=0x7f09601fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0960071090 0x7f09601fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600cd6c0 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.690+0000 7f0964d88640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f095000e6d0 tx=0x7f095000eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095000cab0 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f095000cd40 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950010690 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09601fdaf0 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.691+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09601613d0 con 0x7f09600706e0 2024-09-17T04:09:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.692+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc1613b0 con 0x7f92cc0ceb90 2024-09-17T04:09:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.692+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f92bc011e20 con 0x7f92cc0ceb90 2024-09-17T04:09:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.693+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0940005290 con 0x7f09600706e0 2024-09-17T04:09:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.693+0000 7fad17fff640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 0x7fad0407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.692+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01006f410 con 0x7fc01015bfc0 2024-09-17T04:09:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.692+0000 7fc00f7fe640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 0x7fbffc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.693+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0950010830 con 0x7f09600706e0 2024-09-17T04:09:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3290162870 con 0x7f329006d2b0 2024-09-17T04:09:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f328001a070 con 0x7f329006d2b0 2024-09-17T04:09:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544c005290 con 0x7f546415b7a0 2024-09-17T04:09:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f8aff407640 1 Processor -- start 2024-09-17T04:09:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f546004a070 con 0x7f546415b7a0 2024-09-17T04:09:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f8aff407640 1 -- start start 2024-09-17T04:09:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f0955ffb640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 0x7f094407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f92d15e9640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 0x7f92b007b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92c8034000 tx=0x7f92c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f095009b910 con 0x7f09600706e0 2024-09-17T04:09:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f328cff9640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 0x7f327c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7fc00f7fe640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 0x7fbffc07b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d30 tx=0x7fc0040090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7f0965589640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 0x7f094407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.694+0000 7fad17fff640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 0x7fad0407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0046b0 tx=0x7fad0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f545affd640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 0x7f544807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f328f7fe640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 0x7f327c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f328009a2a0 con 0x7f329006d2b0 2024-09-17T04:09:56.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f54600c3b70 con 0x7f546415b7a0 2024-09-17T04:09:56.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f546a33d640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 0x7f544807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f0965589640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 0x7f094407b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f095c009230 tx=0x7f095c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f328f7fe640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 0x7f327c07b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3284034000 tx=0x7f32840046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.695+0000 7f546a33d640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 0x7f544807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f545400bb20 tx=0x7f545400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 0x7f8af8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8af815ffb0 con 0x7f8af80b5260 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8af815fe30 con 0x7f8af806def0 2024-09-17T04:09:56.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8aff407640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8071300 con 0x7f8af80b5670 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48988/0 (socket says 172.21.15.104:48988) 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 -- 172.21.15.104:0/1822453021 learned_addr learned my addr 172.21.15.104:0/1822453021 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afd1a3640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 0x7f8af8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afd9a4640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 -- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 msgr2=0x7f8af80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 -- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 msgr2=0x7f8af8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 0x7f8af8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:56.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 -- 172.21.15.104:0/1822453021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af81f5600 con 0x7f8af80b5260 2024-09-17T04:09:56.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afd1a3640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 0x7f8af8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:56.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.697+0000 7f8afc9a2640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b3f0 tx=0x7f8ae800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804040030 con 0x7fb800008170 2024-09-17T04:09:56.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8015020 con 0x7f8af80b5260 2024-09-17T04:09:56.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8000e68c0 con 0x7fb800008170 2024-09-17T04:09:56.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af81f4a80 con 0x7f8af80b5260 2024-09-17T04:09:56.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad1003f030 con 0x7fad1815bfc0 2024-09-17T04:09:56.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80016d470 con 0x7fb800008170 2024-09-17T04:09:56.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.699+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc008062890 con 0x7fc01015bfc0 2024-09-17T04:09:56.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.700+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0950063490 con 0x7f09600706e0 2024-09-17T04:09:56.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.700+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81f5040 con 0x7f8af80b5260 2024-09-17T04:09:56.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.700+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8000e6de0 con 0x7fb800008170 2024-09-17T04:09:56.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.701+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af81f47d0 con 0x7f8af80b5260 2024-09-17T04:09:56.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.704+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3290162870 con 0x7f329006d2b0 2024-09-17T04:09:56.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.705+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8040044c0 con 0x7fb800008170 2024-09-17T04:09:56.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.705+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80404a060 con 0x7fb800008170 2024-09-17T04:09:56.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.705+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5464153a80 con 0x7f546415b7a0 2024-09-17T04:09:56.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.705+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ae8011830 con 0x7f8af80b5260 2024-09-17T04:09:56.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.706+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8011c60 con 0x7f8af80b5260 2024-09-17T04:09:56.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.707+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92cc1613b0 con 0x7f92cc0ceb90 2024-09-17T04:09:56.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.711+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ae8018020 con 0x7f8af80b5260 2024-09-17T04:09:56.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.712+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb804043030 con 0x7fb800008170 2024-09-17T04:09:56.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.714+0000 7f8aedffb640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 0x7f8adc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.713+0000 7fb7feffd640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 0x7fb7ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:56.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.713+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8040bc340 con 0x7fb800008170 2024-09-17T04:09:56.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.714+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8ae809b290 con 0x7f8af80b5260 2024-09-17T04:09:56.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.714+0000 7fb80dca6640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 0x7fb7ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.715+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb8000e6de0 con 0x7fb800008170 2024-09-17T04:09:56.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.716+0000 7f8afd1a3640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 0x7f8adc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:56.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.724+0000 7fb80dca6640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 0x7fb7ec07b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb800051bf0 tx=0x7fb7f8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:56.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.724+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ae801f020 con 0x7f8af80b5260 2024-09-17T04:09:56.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:56.732+0000 7f8afd1a3640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 0x7f8adc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8af815efd0 tx=0x7f8af4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:57.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.113+0000 7f09677ed640 1 -- 172.21.15.104:0/4094934639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0940005580 con 0x7f09600706e0 2024-09-17T04:09:57.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.114+0000 7f0955ffb640 1 -- 172.21.15.104:0/4094934639 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f095006c020 con 0x7f09600706e0 2024-09-17T04:09:57.114 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:57.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.117+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 msgr2=0x7f094407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.117+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 0x7f094407b0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f095c009230 tx=0x7f095c004730 comp rx=0 tx=0).stop 2024-09-17T04:09:57.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 msgr2=0x7f0960160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f095000e6d0 tx=0x7f095000eb90 comp rx=0 tx=0).stop 2024-09-17T04:09:57.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 shutdown_connections 2024-09-17T04:09:57.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0944078be0 0x7f094407b0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0960071090 0x7f09601fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09600706e0 0x7f0960160580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 --2- 172.21.15.104:0/4094934639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f096006ff00 0x7f09600cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 >> 172.21.15.104:0/4094934639 conn(0x7f09600cdca0 msgr2=0x7f09600d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 shutdown_connections 2024-09-17T04:09:57.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.118+0000 7f094b7fe640 1 -- 172.21.15.104:0/4094934639 wait complete. 2024-09-17T04:09:57.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.123+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f544c005580 con 0x7f546415b7a0 2024-09-17T04:09:57.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.125+0000 7f545affd640 1 -- 172.21.15.104:0/1156682969 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f546008be50 con 0x7f546415b7a0 2024-09-17T04:09:57.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.125+0000 7fc016215640 1 -- 172.21.15.104:0/4270398778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc0100749e0 con 0x7fc01015bfc0 2024-09-17T04:09:57.126 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:57.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.125+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7facf8005580 con 0x7fad1815bfc0 2024-09-17T04:09:57.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.126+0000 7fad14ff9640 1 -- 172.21.15.104:0/2099485095 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad100847f0 con 0x7fad1815bfc0 2024-09-17T04:09:57.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.126+0000 7fbff7fff640 1 -- 172.21.15.104:0/4270398778 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0080672c0 con 0x7fc01015bfc0 2024-09-17T04:09:57.128 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:57.128 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-09-17T04:09:57.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 msgr2=0x7f544807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 0x7f544807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f545400bb20 tx=0x7f545400d040 comp rx=0 tx=0).stop 2024-09-17T04:09:57.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 msgr2=0x7f5464153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54600084c0 tx=0x7f5460004d40 comp rx=0 tx=0).stop 2024-09-17T04:09:57.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 shutdown_connections 2024-09-17T04:09:57.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 msgr2=0x7fbffc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.129+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 0x7fbffc07b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d30 tx=0x7fc0040090e0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 msgr2=0x7fc0100cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 0x7fc0100cca20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc00800bdd0 tx=0x7fc008009ed0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 shutdown_connections 2024-09-17T04:09:57.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbffc078c60 0x7fbffc07b170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01015bfc0 0x7fc0100cca20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0100b5260 0x7fc0100cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 --2- 172.21.15.104:0/4270398778 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc01006def0 0x7fc0100cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5448078bc0 0x7f544807b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f546415b7a0 0x7f5464153540 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 >> 172.21.15.104:0/4270398778 conn(0x7fc0100cdca0 msgr2=0x7fc0100ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f546415ecd0 0x7f54641f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 --2- 172.21.15.104:0/1156682969 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54640ccc00 0x7f5464155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 >> 172.21.15.104:0/1156682969 conn(0x7f546406f920 msgr2=0x7f546415bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 shutdown_connections 2024-09-17T04:09:57.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 shutdown_connections 2024-09-17T04:09:57.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fbff5ffb640 1 -- 172.21.15.104:0/4270398778 wait complete. 2024-09-17T04:09:57.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7f546b33f640 1 -- 172.21.15.104:0/1156682969 wait complete. 2024-09-17T04:09:57.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 msgr2=0x7fad0407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 0x7fad0407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0046b0 tx=0x7fad0c009040 comp rx=0 tx=0).stop 2024-09-17T04:09:57.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 msgr2=0x7fad180cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad10009000 tx=0x7fad10003f10 comp rx=0 tx=0).stop 2024-09-17T04:09:57.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 shutdown_connections 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fad04078c90 0x7fad0407b1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad180b5260 0x7fad180cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad1815bfc0 0x7fad180cff70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 --2- 172.21.15.104:0/2099485095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad1806def0 0x7fad181517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 >> 172.21.15.104:0/2099485095 conn(0x7fad180cdca0 msgr2=0x7fad180ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.130+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 shutdown_connections 2024-09-17T04:09:57.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.131+0000 7fad1e2d5640 1 -- 172.21.15.104:0/2099485095 wait complete. 2024-09-17T04:09:57.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.131+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f329015f960 con 0x7f329006d2b0 2024-09-17T04:09:57.141 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-09-17T04:09:57.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.132+0000 7f328cff9640 1 -- 172.21.15.104:0/1235310475 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f329015f960 con 0x7f329006d2b0 2024-09-17T04:09:57.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.132+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f92cc158730 con 0x7f92cc0ceb90 2024-09-17T04:09:57.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.133+0000 7f92c1ffb640 1 -- 172.21.15.104:0/2668186840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92cc1592d0 con 0x7f92cc0ceb90 2024-09-17T04:09:57.142 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:57.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 msgr2=0x7f92b007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 0x7f92b007b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92c8034000 tx=0x7f92c8004730 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 msgr2=0x7f92cc157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c390 tx=0x7f92bc00c850 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 shutdown_connections 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f92b0078be0 0x7f92b007b0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92cc15ee80 0x7f92cc06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92cc0ceb90 0x7f92cc157d20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 --2- 172.21.15.104:0/2668186840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92cc0b9ad0 0x7f92cc1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.136+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 >> 172.21.15.104:0/2668186840 conn(0x7f92cc09d830 msgr2=0x7f92cc160ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 shutdown_connections 2024-09-17T04:09:57.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 msgr2=0x7f327c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 0x7f327c07b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3284034000 tx=0x7f32840046c0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 msgr2=0x7f32900c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f328000c430 tx=0x7f328000c8f0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f92d384d640 1 -- 172.21.15.104:0/2668186840 wait complete. 2024-09-17T04:09:57.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 shutdown_connections 2024-09-17T04:09:57.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f327c078c90 0x7f327c07b1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f329015e500 0x7f329014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f32900cf840 0x7f329014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 --2- 172.21.15.104:0/1235310475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f329006d2b0 0x7f32900c97e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 >> 172.21.15.104:0/1235310475 conn(0x7f32900d1960 msgr2=0x7f3290162160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 shutdown_connections 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.137+0000 7f32956ef640 1 -- 172.21.15.104:0/1235310475 wait complete. 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.138+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb8000e6620 con 0x7fb800008170 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.138+0000 7fb7feffd640 1 -- 172.21.15.104:0/526303853 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8000e6620 con 0x7fb800008170 2024-09-17T04:09:57.147 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.142+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 msgr2=0x7fb7ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.142+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 0x7fb7ec07b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb800051bf0 tx=0x7fb7f8005f90 comp rx=0 tx=0).stop 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.142+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 msgr2=0x7fb8000d5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.142+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 0x7fb8000d5cb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb804004000 tx=0x7fb804005a20 comp rx=0 tx=0).stop 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 shutdown_connections 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb7ec078b90 0x7fb7ec07b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8000514d0 0x7fb80003a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8000e0e20 0x7fb80003ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 --2- 172.21.15.104:0/526303853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb800008170 0x7fb8000d5cb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.143+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 >> 172.21.15.104:0/526303853 conn(0x7fb80001fbe0 msgr2=0x7fb8000e3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.144+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 shutdown_connections 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.144+0000 7fb80f4a9640 1 -- 172.21.15.104:0/526303853 wait complete. 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.147+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8af806dcb0 con 0x7f8af80b5260 2024-09-17T04:09:57.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.148+0000 7f8aedffb640 1 -- 172.21.15.104:0/1822453021 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ae8062db0 con 0x7f8af80b5260 2024-09-17T04:09:57.151 INFO:teuthology.orchestra.run.smithi104.stdout:64424509446 2024-09-17T04:09:57.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-09-17T04:09:57.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 msgr2=0x7f8adc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 0x7f8adc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8af815efd0 tx=0x7f8af4005f90 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 msgr2=0x7f8af815ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800b3f0 tx=0x7f8ae800b8b0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 shutdown_connections 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f8adc078b90 0x7f8adc07b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af80b5670 0x7f8af80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8af80b5260 0x7f8af815ad40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 --2- 172.21.15.104:0/1822453021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af806def0 0x7f8af8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:57.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 >> 172.21.15.104:0/1822453021 conn(0x7f8af80cdca0 msgr2=0x7f8af8073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:57.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 shutdown_connections 2024-09-17T04:09:57.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:57.152+0000 7f8aff407640 1 -- 172.21.15.104:0/1822453021 wait complete. 2024-09-17T04:09:57.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-09-17T04:09:57.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-17T04:09:57.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-09-17T04:09:57.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-17T04:09:57.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2024-09-17T04:09:58.144 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T04:09:58.152 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T04:09:58.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T04:09:58.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T04:09:58.160 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T04:09:58.160 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T04:09:58.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T04:09:58.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T04:09:58.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.343+0000 7f28c6c06640 1 -- 172.21.15.104:0/3735841978 reap_dead start 2024-09-17T04:09:58.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.343+0000 7f28c8669640 1 -- 172.21.15.104:0/3735841978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28ac004800 msgr2=0x7f28ac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.343+0000 7f28c8669640 1 --2- 172.21.15.104:0/3735841978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28ac004800 0x7f28ac004c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28c007a9a0 tx=0x7f28ac005830 comp rx=0 tx=0).stop 2024-09-17T04:09:58.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.344+0000 7f28c8669640 1 -- 172.21.15.104:0/3735841978 shutdown_connections 2024-09-17T04:09:58.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.344+0000 7f28c8669640 1 --2- 172.21.15.104:0/3735841978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28ac004800 0x7f28ac004c10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.344+0000 7f28c8669640 1 -- 172.21.15.104:0/3735841978 >> 172.21.15.104:0/3735841978 conn(0x7f28b801ddf0 msgr2=0x7f28b8039ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.344+0000 7f28c8669640 1 -- 172.21.15.104:0/3735841978 shutdown_connections 2024-09-17T04:09:58.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.344+0000 7f28c8669640 1 -- 172.21.15.104:0/3735841978 wait complete. 2024-09-17T04:09:58.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.348+0000 7f28c8669640 1 Processor -- start 2024-09-17T04:09:58.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.348+0000 7f28c8669640 1 -- start start 2024-09-17T04:09:58.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.351+0000 7f28c8669640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.351+0000 7f28c8669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.351+0000 7f28c5c04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.351+0000 7f28c5c04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49008/0 (socket says 172.21.15.104:49008) 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c6405640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c6405640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60310/0 (socket says 172.21.15.104:60310) 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c5c04640 1 -- 172.21.15.104:0/2554655719 learned_addr learned my addr 172.21.15.104:0/2554655719 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c8669640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28b8181fd0 0x7f28b8180b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80e7a50 con 0x7f28b8181650 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80e78d0 con 0x7f28b8181fd0 2024-09-17T04:09:58.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.352+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f28b8033e50 con 0x7f28ac004800 2024-09-17T04:09:58.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.353+0000 7f28c5c04640 1 -- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 msgr2=0x7f28b80cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.353+0000 7f28c5c04640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.353+0000 7f28c5c04640 1 -- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28b8181fd0 msgr2=0x7f28b8180b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:09:58.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.353+0000 7f28c5c04640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28b8181fd0 0x7f28b8180b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.353+0000 7f28c5c04640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b817fa70 con 0x7f28b8181650 2024-09-17T04:09:58.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.354+0000 7f28c5c04640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28c006ba80 tx=0x7f28c0063800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.354+0000 7f28c6405640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:09:58.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.354+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0063cb0 con 0x7f28b8181650 2024-09-17T04:09:58.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.355+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28c0063e50 con 0x7f28b8181650 2024-09-17T04:09:58.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.355+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b817fd50 con 0x7f28b8181650 2024-09-17T04:09:58.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.358+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b8180310 con 0x7f28b8181650 2024-09-17T04:09:58.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.358+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0064240 con 0x7f28b8181650 2024-09-17T04:09:58.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.359+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28c00644a0 con 0x7f28b8181650 2024-09-17T04:09:58.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.359+0000 7f28b6ffd640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 0x7f28ac07cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.360+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f28c013c060 con 0x7f28b8181650 2024-09-17T04:09:58.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.360+0000 7f28c6405640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 0x7f28ac07cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.361+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b817f7e0 con 0x7f28b8181650 2024-09-17T04:09:58.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.371+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28c00bd030 con 0x7f28b8181650 2024-09-17T04:09:58.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.372+0000 7f28c6405640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 0x7f28ac07cea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0018b0 tx=0x7f28bc001cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f025bfff640 1 -- 172.21.15.104:0/2988483961 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260005280 con 0x7f026406dc40 2024-09-17T04:09:58.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f46f77fe640 1 -- 172.21.15.104:0/1235457826 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8032890 con 0x7f46f8162450 2024-09-17T04:09:58.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f46feda1640 1 -- 172.21.15.104:0/1235457826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f8162450 msgr2=0x7f46f8162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f46feda1640 1 --2- 172.21.15.104:0/1235457826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f8162450 0x7f46f8162860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009830 tx=0x7f46e802a390 comp rx=0 tx=0).stop 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 -- 172.21.15.104:0/1235457826 shutdown_connections 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 --2- 172.21.15.104:0/1235457826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f8162450 0x7f46f8162860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f026a164640 1 -- 172.21.15.104:0/2988483961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f026406dc40 msgr2=0x7f02640aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 --2- 172.21.15.104:0/1235457826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 0x7f46f8072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 -- 172.21.15.104:0/1235457826 >> 172.21.15.104:0/1235457826 conn(0x7f46f80b1b90 msgr2=0x7f46f80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.400+0000 7f026a164640 1 --2- 172.21.15.104:0/2988483961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f026406dc40 0x7f02640aef90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f026406ea40 tx=0x7f026002a5a0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 -- 172.21.15.104:0/1235457826 shutdown_connections 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 -- 172.21.15.104:0/2988483961 shutdown_connections 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 --2- 172.21.15.104:0/2988483961 >> v2:172.21.15.192:3300/0 conn(0x7f0264070770 0x7f0264155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 --2- 172.21.15.104:0/2988483961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026415f590 0x7f0264070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 --2- 172.21.15.104:0/2988483961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f026406dc40 0x7f02640aef90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 -- 172.21.15.104:0/2988483961 >> 172.21.15.104:0/2988483961 conn(0x7f02640cfec0 msgr2=0x7f02640d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 -- 172.21.15.104:0/2988483961 shutdown_connections 2024-09-17T04:09:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f026a164640 1 -- 172.21.15.104:0/2988483961 wait complete. 2024-09-17T04:09:58.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.401+0000 7f46feda1640 1 -- 172.21.15.104:0/1235457826 wait complete. 2024-09-17T04:09:58.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.404+0000 7f46feda1640 1 Processor -- start 2024-09-17T04:09:58.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.404+0000 7f026a164640 1 Processor -- start 2024-09-17T04:09:58.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.404+0000 7f46feda1640 1 -- start start 2024-09-17T04:09:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 0x7f46f80a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 0x7f46f806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806e180 con 0x7f46f8162450 2024-09-17T04:09:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806e000 con 0x7f46f80cc160 2024-09-17T04:09:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f46feda1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f46f806e300 con 0x7f46f80aee70 2024-09-17T04:09:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.406+0000 7f026a164640 1 -- start start 2024-09-17T04:09:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f03977fe640 1 -- 172.21.15.104:0/174506686 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039000a310 con 0x7f0398072d90 2024-09-17T04:09:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 -- 172.21.15.104:0/174506686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0398072d90 msgr2=0x7f03980731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 --2- 172.21.15.104:0/174506686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0398072d90 0x7f03980731a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f039000afd0 tx=0x7f039002b7a0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 -- 172.21.15.104:0/174506686 shutdown_connections 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 --2- 172.21.15.104:0/174506686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0398072d90 0x7f03980731a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 --2- 172.21.15.104:0/174506686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f039806ddf0 0x7f039806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 -- 172.21.15.104:0/174506686 >> 172.21.15.104:0/174506686 conn(0x7f03980b1b90 msgr2=0x7f03980b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 0x7f46f806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 -- 172.21.15.104:0/174506686 shutdown_connections 2024-09-17T04:09:58.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f46fd33e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f46fcb3d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 0x7f46f80a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f46fd33e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49080/0 (socket says 172.21.15.104:49080) 2024-09-17T04:09:58.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f46fd33e640 1 -- 172.21.15.104:0/2085830186 learned_addr learned my addr 172.21.15.104:0/2085830186 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.407+0000 7f039ed24640 1 -- 172.21.15.104:0/174506686 wait complete. 2024-09-17T04:09:58.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 -- 172.21.15.104:0/64345263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 msgr2=0x7fd7f80cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 --2- 172.21.15.104:0/64345263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80cee70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80ce420 tx=0x7fd7ec02a5a0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46f7fff640 1 -- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 msgr2=0x7f46f80a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46f7fff640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 0x7f46f80a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46f7fff640 1 -- 172.21.15.104:0/2085830186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 msgr2=0x7f46f815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46f7fff640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46f7fff640 1 -- 172.21.15.104:0/2085830186 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f809e500 con 0x7f46f80cc160 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f46fd33e640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:58.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 -- 172.21.15.104:0/64345263 shutdown_connections 2024-09-17T04:09:58.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f7b4114e640 1 -- 172.21.15.104:0/3162008299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34056da0 msgr2=0x7f7b34057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7f7b4114e640 1 --2- 172.21.15.104:0/3162008299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34056da0 0x7f7b34057c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400fcc0 tx=0x7f7b3002a480 comp rx=0 tx=0).stop 2024-09-17T04:09:58.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 --2- 172.21.15.104:0/64345263 >> v2:172.21.15.192:3300/0 conn(0x7fd7f806e330 0x7fd7f81622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 --2- 172.21.15.104:0/64345263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 --2- 172.21.15.104:0/64345263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80cee70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.408+0000 7fd7fc830640 1 -- 172.21.15.104:0/64345263 >> 172.21.15.104:0/64345263 conn(0x7fd7f80735d0 msgr2=0x7fd7f80739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 -- 172.21.15.104:0/3749395661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100e7850 msgr2=0x7fb0100e3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0264070770 0x7f0264143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f026415f590 0x7f02641f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0264155a80 con 0x7f0264070770 2024-09-17T04:09:58.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46f7fff640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 0x7f46f806ee30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f46f000cc50 tx=0x7f46f000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0264155900 con 0x7f026415f590 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f026a164640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f02640cddc0 con 0x7f026406dc40 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 --2- 172.21.15.104:0/3749395661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100e7850 0x7fb0100e3140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb01003bd30 tx=0x7fb00c02a5b0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f7b4114e640 1 -- 172.21.15.104:0/3162008299 shutdown_connections 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f7b4114e640 1 --2- 172.21.15.104:0/3162008299 >> v2:172.21.15.104:3300/0 conn(0x7f7b340e2f40 0x7f7b3403c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f7b4114e640 1 --2- 172.21.15.104:0/3162008299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34056da0 0x7f7b34057c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f7b4114e640 1 -- 172.21.15.104:0/3162008299 >> 172.21.15.104:0/3162008299 conn(0x7f7b3403a5f0 msgr2=0x7f7b3403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60382/0 (socket says 172.21.15.104:60382) 2024-09-17T04:09:58.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 -- 172.21.15.104:0/437384065 learned_addr learned my addr 172.21.15.104:0/437384065 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0016020 con 0x7f46f80cc160 2024-09-17T04:09:58.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 -- 172.21.15.104:0/3749395661 shutdown_connections 2024-09-17T04:09:58.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0268961640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0264070770 0x7f0264143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 --2- 172.21.15.104:0/3749395661 >> v2:172.21.15.192:3300/0 conn(0x7fb010007670 0x7fb0100379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 --2- 172.21.15.104:0/3749395661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100e7850 0x7fb0100e3140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f0012420 con 0x7f46f80cc160 2024-09-17T04:09:58.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fb01d729640 1 -- 172.21.15.104:0/3749395661 >> 172.21.15.104:0/3749395661 conn(0x7fb01000e240 msgr2=0x7fb01000e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f000ce60 con 0x7f46f80cc160 2024-09-17T04:09:58.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fd7fc830640 1 -- 172.21.15.104:0/64345263 shutdown_connections 2024-09-17T04:09:58.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7fd7fc830640 1 -- 172.21.15.104:0/64345263 wait complete. 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f809e7e0 con 0x7f46f80cc160 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f809f2c0 con 0x7f46f80cc160 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 -- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f026415f590 msgr2=0x7f02641f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f026415f590 0x7f02641f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 -- 172.21.15.104:0/437384065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0264070770 msgr2=0x7f0264143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0264070770 0x7f0264143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.409+0000 7f0269162640 1 -- 172.21.15.104:0/437384065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02641565c0 con 0x7f026406dc40 2024-09-17T04:09:58.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7fb01d729640 1 -- 172.21.15.104:0/3749395661 shutdown_connections 2024-09-17T04:09:58.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7fb01d729640 1 -- 172.21.15.104:0/3749395661 wait complete. 2024-09-17T04:09:58.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f0269162640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f026002ab90 tx=0x7f0260004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 -- 172.21.15.104:0/589259900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 msgr2=0x7f688815ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 --2- 172.21.15.104:0/589259900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f688815ee80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f687c009830 tx=0x7f687c02a480 comp rx=0 tx=0).stop 2024-09-17T04:09:58.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f039ed24640 1 Processor -- start 2024-09-17T04:09:58.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260041070 con 0x7f026406dc40 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f039ed24640 1 -- start start 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0260031960 con 0x7f026406dc40 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 -- 172.21.15.104:0/589259900 shutdown_connections 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 --2- 172.21.15.104:0/589259900 >> v2:172.21.15.104:3300/0 conn(0x7f6888073df0 0x7f688806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 --2- 172.21.15.104:0/589259900 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f688815ee80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 -- 172.21.15.104:0/589259900 >> 172.21.15.104:0/589259900 conn(0x7f68880cd460 msgr2=0x7f68880cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260031db0 con 0x7f026406dc40 2024-09-17T04:09:58.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0264143e40 con 0x7f026406dc40 2024-09-17T04:09:58.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02640b4960 con 0x7f026406dc40 2024-09-17T04:09:58.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.410+0000 7f688f24d640 1 -- 172.21.15.104:0/589259900 shutdown_connections 2024-09-17T04:09:58.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.411+0000 7f688f24d640 1 -- 172.21.15.104:0/589259900 wait complete. 2024-09-17T04:09:58.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.412+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f80a11c0 con 0x7f46f80cc160 2024-09-17T04:09:58.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.412+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0264152490 con 0x7f026406dc40 2024-09-17T04:09:58.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7fb01d729640 1 Processor -- start 2024-09-17T04:09:58.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7fd7fc830640 1 Processor -- start 2024-09-17T04:09:58.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f7b4114e640 1 -- 172.21.15.104:0/3162008299 shutdown_connections 2024-09-17T04:09:58.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46f0019020 con 0x7f46f80cc160 2024-09-17T04:09:58.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039ed24640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 0x7f0398159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039ed24640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0398072d90 0x7f03980c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039ed24640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 0x7f03980c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7fb01d729640 1 -- start start 2024-09-17T04:09:58.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039ed24640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f03980736e0 con 0x7f039806ddf0 2024-09-17T04:09:58.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039d2c1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 0x7f03980c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039d2c1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 0x7f03980c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52390/0 (socket says 172.21.15.104:52390) 2024-09-17T04:09:58.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039d2c1640 1 -- 172.21.15.104:0/1932240497 learned_addr learned my addr 172.21.15.104:0/1932240497 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f46f57fa640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 0x7f46e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0260044070 con 0x7f026406dc40 2024-09-17T04:09:58.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0398071090 con 0x7f039815ac20 2024-09-17T04:09:58.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0398073860 con 0x7f0398072d90 2024-09-17T04:09:58.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f46f009b840 con 0x7f46f80cc160 2024-09-17T04:09:58.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f688f24d640 1 Processor -- start 2024-09-17T04:09:58.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f7b4114e640 1 -- 172.21.15.104:0/3162008299 wait complete. 2024-09-17T04:09:58.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f688f24d640 1 -- start start 2024-09-17T04:09:58.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f0259ffb640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 0x7f024807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f039cac0640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 0x7f0398159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f0397fff640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0398072d90 0x7f03980c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f02600bc080 con 0x7f026406dc40 2024-09-17T04:09:58.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.414+0000 7f46fcb3d640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 0x7f46e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 -- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0398072d90 msgr2=0x7f03980c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0398072d90 0x7f03980c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 -- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 msgr2=0x7f03980c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 0x7f03980c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0398167560 con 0x7f039806ddf0 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.413+0000 7fd7fc830640 1 -- start start 2024-09-17T04:09:58.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fd7fc830640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 0x7fd7f80b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f0268961640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 0x7f024807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f039cac0640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 0x7f0398159380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f038c00b410 tx=0x7f038c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fd7fc830640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f46fcb3d640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 0x7f46e407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009b90 tx=0x7f46ec005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 0x7fb01017d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fd7fc830640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 0x7fb0100061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb010006700 0x7fb0100d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb010056a90 con 0x7fb0100375b0 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb010056910 con 0x7fb0100e7850 2024-09-17T04:09:58.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7fb01d729640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb010056c10 con 0x7fb010006700 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 0x7fb0100061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 0x7fb01017d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 0x7fb0100061c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52416/0 (socket says 172.21.15.104:52416) 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb0177fe640 1 -- 172.21.15.104:0/2528291182 learned_addr learned my addr 172.21.15.104:0/2528291182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb01cf28640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb010006700 0x7fb0100d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f5d9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f5d9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:60406/0 (socket says 172.21.15.104:60406) 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.415+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c015020 con 0x7f039806ddf0 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03981f96a0 con 0x7f039806ddf0 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03981f9950 con 0x7f039806ddf0 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f038c011920 con 0x7f039806ddf0 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c011d70 con 0x7f039806ddf0 2024-09-17T04:09:58.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7f0268961640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 0x7f024807b1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0264155530 tx=0x7f025c0095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 0x7fd7f80b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 0x7fd7f80b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52406/0 (socket says 172.21.15.104:52406) 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 -- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb010006700 msgr2=0x7fb0100d8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb010006700 0x7fb0100d8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 -- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 msgr2=0x7fb0100061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 0x7fb0100061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fb017fff640 1 -- 172.21.15.104:0/2528291182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01017db30 con 0x7fb0100375b0 2024-09-17T04:09:58.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.416+0000 7fd7f6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49110/0 (socket says 172.21.15.104:49110) 2024-09-17T04:09:58.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7fd7f5d9b640 1 -- 172.21.15.104:0/913182702 learned_addr learned my addr 172.21.15.104:0/913182702 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7fd7fc830640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8162990 con 0x7fd7f815e990 2024-09-17T04:09:58.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f7b4114e640 1 Processor -- start 2024-09-17T04:09:58.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7fb017fff640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 0x7fb01017d2a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb010011bc0 tx=0x7fb00c004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f68880b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68881695f0 0x7f68880b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f68880af4a0 con 0x7f68881695f0 2024-09-17T04:09:58.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68880b5ff0 con 0x7f68880b59d0 2024-09-17T04:09:58.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f7b4114e640 1 -- start start 2024-09-17T04:09:58.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688f24d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f68880af620 con 0x7f688815ae30 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:52432/0 (socket says 172.21.15.104:52432) 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 -- 172.21.15.104:0/1804976633 learned_addr learned my addr 172.21.15.104:0/1804976633 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688d7ea640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68881695f0 0x7f68880b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7fd7fc830640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8162810 con 0x7fd7f806e330 2024-09-17T04:09:58.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7fd7fc830640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f8162b10 con 0x7fd7f80cf3b0 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f6887fff640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f68880b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 -- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 msgr2=0x7f68880b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f68880b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 -- 172.21.15.104:0/1804976633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68881695f0 msgr2=0x7f68880b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68881695f0 0x7f68880b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.417+0000 7f688cfe9640 1 -- 172.21.15.104:0/1804976633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888168070 con 0x7f68880b59d0 2024-09-17T04:09:58.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0378005290 con 0x7f039806ddf0 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 -- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 msgr2=0x7fd7f80b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 -- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 msgr2=0x7fd7f80b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 0x7fd7f80b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f80b4020 con 0x7fd7f815e990 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7f688cfe9640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f687c02aa70 tx=0x7f687c033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c03e020 con 0x7fb0100375b0 2024-09-17T04:09:58.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f5d9b640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:58.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb00c003a00 con 0x7fb0100375b0 2024-09-17T04:09:58.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01017de10 con 0x7fb0100375b0 2024-09-17T04:09:58.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fd7f6d9d640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b3e0 tx=0x7fd7e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c031d60 con 0x7f68880b59d0 2024-09-17T04:09:58.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.418+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c035070 con 0x7fb0100375b0 2024-09-17T04:09:58.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0100dacd0 con 0x7fb0100375b0 2024-09-17T04:09:58.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46f0020020 con 0x7f46f80cc160 2024-09-17T04:09:58.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f687c033e50 con 0x7f68880b59d0 2024-09-17T04:09:58.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6888169d60 con 0x7f68880b59d0 2024-09-17T04:09:58.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688816a320 con 0x7f68880b59d0 2024-09-17T04:09:58.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f7b4114e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 0x7f7b340cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f7b4114e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f7b4114e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b340e2f40 0x7f7b3404e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.419+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f038c018020 con 0x7f039806ddf0 2024-09-17T04:09:58.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b4114e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7b34007110 con 0x7f7b34056da0 2024-09-17T04:09:58.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b3b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b3b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49126/0 (socket says 172.21.15.104:49126) 2024-09-17T04:09:58.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b3b7fe640 1 -- 172.21.15.104:0/2657737396 learned_addr learned my addr 172.21.15.104:0/2657737396 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7b34006f90 con 0x7f7b340e2f40 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7b34007290 con 0x7f7b34053c50 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b4094d640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b340e2f40 0x7f7b3404e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f7b3bfff640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 0x7f7b340cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f03957fa640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 0x7f037c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.420+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c033310 con 0x7f68880b59d0 2024-09-17T04:09:58.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 -- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b340e2f40 msgr2=0x7f7b3404e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b340e2f40 0x7f7b3404e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 -- 172.21.15.104:0/2657737396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 msgr2=0x7f7b3404d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0264152490 con 0x7f026406dc40 2024-09-17T04:09:58.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6868005290 con 0x7f68880b59d0 2024-09-17T04:09:58.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340d94a0 con 0x7f7b34053c50 2024-09-17T04:09:58.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f0397fff640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 0x7f037c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3b7fe640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:09:58.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f038c09aec0 con 0x7f039806ddf0 2024-09-17T04:09:58.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.422+0000 7f0397fff640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 0x7f037c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03980c88e0 tx=0x7f0384009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.422+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb00c041020 con 0x7fb0100375b0 2024-09-17T04:09:58.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f687c0334b0 con 0x7f68880b59d0 2024-09-17T04:09:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7f7b3bfff640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 0x7f7b340cff80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b34057250 tx=0x7f7b30030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.422+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30030c50 con 0x7f7b34053c50 2024-09-17T04:09:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.422+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b30030e30 con 0x7f7b34053c50 2024-09-17T04:09:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7fb014ff9640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 0x7faffc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb00c0bba00 con 0x7fb0100375b0 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30004280 con 0x7f7b34053c50 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b340d9780 con 0x7f7b34053c50 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3404c880 con 0x7f7b34053c50 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8015020 con 0x7fd7f815e990 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e8011920 con 0x7fd7f815e990 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8011d70 con 0x7fd7f815e990 2024-09-17T04:09:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7fd7fc830640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f80b4460 con 0x7fd7f815e990 2024-09-17T04:09:58.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.421+0000 7fd7fc830640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f8160ee0 con 0x7fd7f815e990 2024-09-17T04:09:58.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f81630b0 con 0x7fd7f815e990 2024-09-17T04:09:58.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7f68857fa640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 0x7f687407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.423+0000 7fb0177fe640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 0x7faffc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01000ef80 con 0x7fb0100375b0 2024-09-17T04:09:58.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f687c0bc300 con 0x7f68880b59d0 2024-09-17T04:09:58.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7f6887fff640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 0x7f687407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7fb0177fe640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 0x7faffc07b170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0101778a0 tx=0x7fb004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b34007810 con 0x7f7b34053c50 2024-09-17T04:09:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.424+0000 7f6887fff640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 0x7f687407b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6888051200 tx=0x7f6878009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.425+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b300035f0 con 0x7f7b34053c50 2024-09-17T04:09:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.425+0000 7f7b38ff9640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 0x7f7b2007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.426+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7b300bbe00 con 0x7f7b34053c50 2024-09-17T04:09:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.426+0000 7f7b3b7fe640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 0x7f7b2007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.426+0000 7f7b3b7fe640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 0x7f7b2007b0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b280096c0 tx=0x7f7b28009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.428+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f687c03f030 con 0x7f68880b59d0 2024-09-17T04:09:58.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.429+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f038c01f020 con 0x7f039806ddf0 2024-09-17T04:09:58.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.431+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b3003f030 con 0x7f7b34053c50 2024-09-17T04:09:58.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.432+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7e8018020 con 0x7fd7f815e990 2024-09-17T04:09:58.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.432+0000 7fd7e6ffd640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 0x7fd7d807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:58.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.433+0000 7fd7f659c640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 0x7fd7d807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:58.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.434+0000 7fd7f659c640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 0x7fd7d807b0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec033000 tx=0x7fd7ec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:58.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.440+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb00c048030 con 0x7fb0100375b0 2024-09-17T04:09:58.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.440+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd7e805f040 con 0x7fd7f815e990 2024-09-17T04:09:58.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.449+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7e801f020 con 0x7fd7f815e990 2024-09-17T04:09:58.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.783+0000 7f28c8669640 1 -- 172.21.15.104:0/2554655719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f28b80076a0 con 0x7f28b8181650 2024-09-17T04:09:58.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.784+0000 7f28b6ffd640 1 -- 172.21.15.104:0/2554655719 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f28c00ff740 con 0x7f28b8181650 2024-09-17T04:09:58.784 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:58.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.788+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 msgr2=0x7f28ac07cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.788+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 0x7f28ac07cea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0018b0 tx=0x7f28bc001cb0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.788+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 msgr2=0x7f28b817f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.788+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f28c006ba80 tx=0x7f28c0063800 comp rx=0 tx=0).stop 2024-09-17T04:09:58.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 shutdown_connections 2024-09-17T04:09:58.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f28ac07a990 0x7f28ac07cea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28b8181fd0 0x7f28b8180b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28b8181650 0x7f28b817f100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 --2- 172.21.15.104:0/2554655719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ac004800 0x7f28b80cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 >> 172.21.15.104:0/2554655719 conn(0x7f28b801ddf0 msgr2=0x7f28b80319c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 shutdown_connections 2024-09-17T04:09:58.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.789+0000 7f28b4ff9640 1 -- 172.21.15.104:0/2554655719 wait complete. 2024-09-17T04:09:58.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-09-17T04:09:58.806 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.820+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7b3404c3d0 con 0x7f7b34053c50 2024-09-17T04:09:58.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.821+0000 7f7b38ff9640 1 -- 172.21.15.104:0/2657737396 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b30083a20 con 0x7f7b34053c50 2024-09-17T04:09:58.821 INFO:teuthology.orchestra.run.smithi104.stdout:64424509447 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 msgr2=0x7f7b2007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 0x7f7b2007b0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b280096c0 tx=0x7f7b28009260 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 msgr2=0x7f7b340cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 0x7f7b340cff80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b34057250 tx=0x7f7b30030650 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 shutdown_connections 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7b20078be0 0x7f7b2007b0f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b340e2f40 0x7f7b3404e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b34056da0 0x7f7b3404d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 --2- 172.21.15.104:0/2657737396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b34053c50 0x7f7b340cff80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.823+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 >> 172.21.15.104:0/2657737396 conn(0x7f7b3403a5f0 msgr2=0x7f7b3403d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.824+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 shutdown_connections 2024-09-17T04:09:58.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.824+0000 7f7b4114e640 1 -- 172.21.15.104:0/2657737396 wait complete. 2024-09-17T04:09:58.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-17T04:09:58.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.836+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f02640aef90 con 0x7f026406dc40 2024-09-17T04:09:58.836 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.837+0000 7f0259ffb640 1 -- 172.21.15.104:0/437384065 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0260083b10 con 0x7f026406dc40 2024-09-17T04:09:58.837 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.838+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f46f8072f90 con 0x7f46f80cc160 2024-09-17T04:09:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.839+0000 7f46f57fa640 1 -- 172.21.15.104:0/2085830186 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46f00638a0 con 0x7f46f80cc160 2024-09-17T04:09:58.838 INFO:teuthology.orchestra.run.smithi104.stdout:64424509450 2024-09-17T04:09:58.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 msgr2=0x7f024807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 0x7f024807b1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0264155530 tx=0x7f025c0095e0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 msgr2=0x7f0264150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f026002ab90 tx=0x7f0260004260 comp rx=0 tx=0).stop 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 shutdown_connections 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0248078c90 0x7f024807b1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f026415f590 0x7f02641f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0264070770 0x7f0264143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 --2- 172.21.15.104:0/437384065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f026406dc40 0x7f0264150d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 >> 172.21.15.104:0/437384065 conn(0x7f02640cfec0 msgr2=0x7f02640d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 shutdown_connections 2024-09-17T04:09:58.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f026a164640 1 -- 172.21.15.104:0/437384065 wait complete. 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 msgr2=0x7f46e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.841+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 0x7f46e407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009b90 tx=0x7f46ec005f30 comp rx=0 tx=0).stop 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 msgr2=0x7f46f806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 0x7f46f806ee30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f46f000cc50 tx=0x7f46f000a430 comp rx=0 tx=0).stop 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 shutdown_connections 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f46e4078b90 0x7f46e407b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f80cc160 0x7f46f806ee30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46f8162450 0x7f46f815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 --2- 172.21.15.104:0/2085830186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f80aee70 0x7f46f80a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 >> 172.21.15.104:0/2085830186 conn(0x7f46f80b1b90 msgr2=0x7f46f815e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 shutdown_connections 2024-09-17T04:09:58.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.842+0000 7f46feda1640 1 -- 172.21.15.104:0/2085830186 wait complete. 2024-09-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.851+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0378005580 con 0x7f039806ddf0 2024-09-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.852+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb0100e0fd0 con 0x7fb0100375b0 2024-09-17T04:09:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.852+0000 7f03957fa640 1 -- 172.21.15.104:0/1932240497 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0398167560 con 0x7f039806ddf0 2024-09-17T04:09:58.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.852+0000 7fb014ff9640 1 -- 172.21.15.104:0/2528291182 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb00c083520 con 0x7fb0100375b0 2024-09-17T04:09:58.852 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:58.852 INFO:teuthology.orchestra.run.smithi104.stdout:64424509448 2024-09-17T04:09:58.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-17T04:09:58.854 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.854+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 msgr2=0x7faffc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 0x7faffc07b170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0101778a0 tx=0x7fb004009040 comp rx=0 tx=0).stop 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 msgr2=0x7fb01017d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 0x7fb01017d2a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb010011bc0 tx=0x7fb00c004d60 comp rx=0 tx=0).stop 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 shutdown_connections 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7faffc078c60 0x7faffc07b170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0100e7850 0x7fb0100061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb010006700 0x7fb0100d8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 --2- 172.21.15.104:0/2528291182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0100375b0 0x7fb01017d2a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 >> 172.21.15.104:0/2528291182 conn(0x7fb01000e240 msgr2=0x7fb0100dffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 shutdown_connections 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7fb01d729640 1 -- 172.21.15.104:0/2528291182 wait complete. 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 msgr2=0x7f037c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 0x7f037c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03980c88e0 tx=0x7f0384009060 comp rx=0 tx=0).stop 2024-09-17T04:09:58.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 msgr2=0x7f0398159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.855+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 0x7f0398159380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f038c00b410 tx=0x7f038c00b8d0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 shutdown_connections 2024-09-17T04:09:58.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6868005580 con 0x7f68880b59d0 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f037c078b90 0x7f037c07b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f039815ac20 0x7f03980c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0398072d90 0x7f03980c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 --2- 172.21.15.104:0/1932240497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f039806ddf0 0x7f0398159380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 >> 172.21.15.104:0/1932240497 conn(0x7f03980b1b90 msgr2=0x7f03980b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 shutdown_connections 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f039ed24640 1 -- 172.21.15.104:0/1932240497 wait complete. 2024-09-17T04:09:58.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.856+0000 7f68857fa640 1 -- 172.21.15.104:0/1804976633 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f688815f3c0 con 0x7f68880b59d0 2024-09-17T04:09:58.859 INFO:teuthology.orchestra.run.smithi104.stdout:55834574857 2024-09-17T04:09:58.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-17T04:09:58.860 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.859+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 msgr2=0x7f687407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.859+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 0x7f687407b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6888051200 tx=0x7f6878009060 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.859+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 msgr2=0x7f6888154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.859+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f687c02aa70 tx=0x7f687c033ba0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 shutdown_connections 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6874078c60 0x7f687407b170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68881695f0 0x7f68880b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f688815ae30 0x7f68880b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 --2- 172.21.15.104:0/1804976633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68880b59d0 0x7f6888154b60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 >> 172.21.15.104:0/1804976633 conn(0x7f68880cd460 msgr2=0x7f68880b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 shutdown_connections 2024-09-17T04:09:58.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.860+0000 7f688f24d640 1 -- 172.21.15.104:0/1804976633 wait complete. 2024-09-17T04:09:58.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.861+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd7f80b41f0 con 0x7fd7f815e990 2024-09-17T04:09:58.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.861+0000 7fd7e6ffd640 1 -- 172.21.15.104:0/913182702 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7f80b4460 con 0x7fd7f815e990 2024-09-17T04:09:58.862 INFO:teuthology.orchestra.run.smithi104.stdout:64424509449 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 msgr2=0x7fd7d807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 0x7fd7d807b0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec033000 tx=0x7fd7ec004730 comp rx=0 tx=0).stop 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 msgr2=0x7fd7f80b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b3e0 tx=0x7fd7e800b8a0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 shutdown_connections 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd7d8078be0 0x7fd7d807b0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f815e990 0x7fd7f80b5f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f80cf3b0 0x7fd7f80b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 --2- 172.21.15.104:0/913182702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f806e330 0x7fd7f80b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:58.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 >> 172.21.15.104:0/913182702 conn(0x7fd7f80735d0 msgr2=0x7fd7f80739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:58.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 shutdown_connections 2024-09-17T04:09:58.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:58.864+0000 7fd7e4ff9640 1 -- 172.21.15.104:0/913182702 wait complete. 2024-09-17T04:09:58.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-17T04:09:58.870 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-17T04:09:58.875 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2024-09-17T04:09:58.877 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-09-17T04:09:58.878 DEBUG:teuthology.parallel:result is None 2024-09-17T04:09:58.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:09:58.878 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:09:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 -- 172.21.15.104:0/1326392345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0406ddf0 msgr2=0x7efe0406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 --2- 172.21.15.104:0/1326392345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0406ddf0 0x7efe0406e200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe04072490 tx=0x7efdfc02a560 comp rx=0 tx=0).stop 2024-09-17T04:09:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 -- 172.21.15.104:0/1326392345 shutdown_connections 2024-09-17T04:09:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 --2- 172.21.15.104:0/1326392345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0406ddf0 0x7efe0406e200 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 --2- 172.21.15.104:0/1326392345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe0415efb0 0x7efe0415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 --2- 172.21.15.104:0/1326392345 >> v2:172.21.15.192:3300/0 conn(0x7efe04073d90 0x7efe04155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 -- 172.21.15.104:0/1326392345 >> 172.21.15.104:0/1326392345 conn(0x7efe040cd870 msgr2=0x7efe04073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 -- 172.21.15.104:0/1326392345 shutdown_connections 2024-09-17T04:09:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.032+0000 7efe08df1640 1 -- 172.21.15.104:0/1326392345 wait complete. 2024-09-17T04:09:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.034+0000 7efe08df1640 1 Processor -- start 2024-09-17T04:09:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.034+0000 7efe08df1640 1 -- start start 2024-09-17T04:09:59.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe0406ddf0 0x7efe041585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe04073d90 0x7efe040c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efe040cf910 con 0x7efe0415efb0 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe040cf790 con 0x7efe0406ddf0 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.035+0000 7efe08df1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efe040cfa90 con 0x7efe04073d90 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49136/0 (socket says 172.21.15.104:49136) 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 -- 172.21.15.104:0/3531960877 learned_addr learned my addr 172.21.15.104:0/3531960877 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe01d9b640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe04073d90 0x7efe040c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe0259c640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe0406ddf0 0x7efe041585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 -- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe04073d90 msgr2=0x7efe040c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe04073d90 0x7efe040c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 -- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe0406ddf0 msgr2=0x7efe041585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe0406ddf0 0x7efe041585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 -- 172.21.15.104:0/3531960877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe041570b0 con 0x7efe0415efb0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe02d9d640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdfc034040 tx=0x7efdfc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc03e030 con 0x7efe0415efb0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdfc0047a0 con 0x7efe0415efb0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe04157550 con 0x7efe0415efb0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc035040 con 0x7efe0415efb0 2024-09-17T04:09:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.036+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe04157b10 con 0x7efe0415efb0 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.037+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe040cffb0 con 0x7efe0415efb0 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.038+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdfc041030 con 0x7efe0415efb0 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.039+0000 7efdfaffd640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 0x7efde407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.039+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efdfc0bb8f0 con 0x7efe0415efb0 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.039+0000 7efe0259c640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 0x7efde407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.039+0000 7efe0259c640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 0x7efde407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe04074e50 tx=0x7efdf4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.043+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efdfc0833a0 con 0x7efe0415efb0 2024-09-17T04:09:59.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.212+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe0406e200 con 0x7efde4078b90 2024-09-17T04:09:59.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.219+0000 7efdfaffd640 1 -- 172.21.15.104:0/3531960877 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7efe0406e200 con 0x7efde4078b90 2024-09-17T04:09:59.222 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:59.224 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 msgr2=0x7efde407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 0x7efde407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe04074e50 tx=0x7efdf4004ab0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 msgr2=0x7efe04145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdfc034040 tx=0x7efdfc0039e0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 shutdown_connections 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7efde4078b90 0x7efde407b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe0415efb0 0x7efe04145a60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe04073d90 0x7efe040c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 --2- 172.21.15.104:0/3531960877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe0406ddf0 0x7efe041585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 >> 172.21.15.104:0/3531960877 conn(0x7efe040cd870 msgr2=0x7efe040b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 shutdown_connections 2024-09-17T04:09:59.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.222+0000 7efe08df1640 1 -- 172.21.15.104:0/3531960877 wait complete. 2024-09-17T04:09:59.233 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-17T04:09:57.347322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219668,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755052,"statfs":{"total":773094113280,"available":772869173248,"internally_reserved":0,"allocated":3514368,"data_stored":2080856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.970139"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488204+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:09:45.488204+0000","last_peered":"2024-09-17T04:09:45.488204+0000","last_clean":"2024-09-17T04:09:45.488204+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:09:45.488204+0000","last_undegraded":"2024-09-17T04:09:45.488204+0000","last_fullsized":"2024-09-17T04:09:45.488204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487142+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:09:45.487142+0000","last_peered":"2024-09-17T04:09:45.487142+0000","last_clean":"2024-09-17T04:09:45.487142+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:09:45.487142+0000","last_undegraded":"2024-09-17T04:09:45.487142+0000","last_fullsized":"2024-09-17T04:09:45.487142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488102+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:09:45.488102+0000","last_peered":"2024-09-17T04:09:45.488102+0000","last_clean":"2024-09-17T04:09:45.488102+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:09:45.488102+0000","last_undegraded":"2024-09-17T04:09:45.488102+0000","last_fullsized":"2024-09-17T04:09:45.488102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487419+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:09:45.487419+0000","last_peered":"2024-09-17T04:09:45.487419+0000","last_clean":"2024-09-17T04:09:45.487419+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:09:45.487419+0000","last_undegraded":"2024-09-17T04:09:45.487419+0000","last_fullsized":"2024-09-17T04:09:45.487419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487870+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:09:45.487870+0000","last_peered":"2024-09-17T04:09:45.487870+0000","last_clean":"2024-09-17T04:09:45.487870+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:09:45.487870+0000","last_undegraded":"2024-09-17T04:09:45.487870+0000","last_fullsized":"2024-09-17T04:09:45.487870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381185+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:09:45.381185+0000","last_peered":"2024-09-17T04:09:45.381185+0000","last_clean":"2024-09-17T04:09:45.381185+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:09:45.381185+0000","last_undegraded":"2024-09-17T04:09:45.381185+0000","last_fullsized":"2024-09-17T04:09:45.381185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488189+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:09:45.488189+0000","last_peered":"2024-09-17T04:09:45.488189+0000","last_clean":"2024-09-17T04:09:45.488189+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:09:45.488189+0000","last_undegraded":"2024-09-17T04:09:45.488189+0000","last_fullsized":"2024-09-17T04:09:45.488189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488154+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:09:45.488154+0000","last_peered":"2024-09-17T04:09:45.488154+0000","last_clean":"2024-09-17T04:09:45.488154+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:09:45.488154+0000","last_undegraded":"2024-09-17T04:09:45.488154+0000","last_fullsized":"2024-09-17T04:09:45.488154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380765+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:09:45.380765+0000","last_peered":"2024-09-17T04:09:45.380765+0000","last_clean":"2024-09-17T04:09:45.380765+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:09:45.380765+0000","last_undegraded":"2024-09-17T04:09:45.380765+0000","last_fullsized":"2024-09-17T04:09:45.380765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488356+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:09:45.488356+0000","last_peered":"2024-09-17T04:09:45.488356+0000","last_clean":"2024-09-17T04:09:45.488356+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:09:45.488356+0000","last_undegraded":"2024-09-17T04:09:45.488356+0000","last_fullsized":"2024-09-17T04:09:45.488356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380259+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:09:45.380259+0000","last_peered":"2024-09-17T04:09:45.380259+0000","last_clean":"2024-09-17T04:09:45.380259+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:09:45.380259+0000","last_undegraded":"2024-09-17T04:09:45.380259+0000","last_fullsized":"2024-09-17T04:09:45.380259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380346+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:09:45.380346+0000","last_peered":"2024-09-17T04:09:45.380346+0000","last_clean":"2024-09-17T04:09:45.380346+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:09:45.380346+0000","last_undegraded":"2024-09-17T04:09:45.380346+0000","last_fullsized":"2024-09-17T04:09:45.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487865+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:09:45.487865+0000","last_peered":"2024-09-17T04:09:45.487865+0000","last_clean":"2024-09-17T04:09:45.487865+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:09:45.487865+0000","last_undegraded":"2024-09-17T04:09:45.487865+0000","last_fullsized":"2024-09-17T04:09:45.487865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379933+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:09:45.379933+0000","last_peered":"2024-09-17T04:09:45.379933+0000","last_clean":"2024-09-17T04:09:45.379933+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:09:45.379933+0000","last_undegraded":"2024-09-17T04:09:45.379933+0000","last_fullsized":"2024-09-17T04:09:45.379933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487666+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:09:45.487666+0000","last_peered":"2024-09-17T04:09:45.487666+0000","last_clean":"2024-09-17T04:09:45.487666+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:09:45.487666+0000","last_undegraded":"2024-09-17T04:09:45.487666+0000","last_fullsized":"2024-09-17T04:09:45.487666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489005+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:09:45.489005+0000","last_peered":"2024-09-17T04:09:45.489005+0000","last_clean":"2024-09-17T04:09:45.489005+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:09:45.489005+0000","last_undegraded":"2024-09-17T04:09:45.489005+0000","last_fullsized":"2024-09-17T04:09:45.489005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381675+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:09:45.381675+0000","last_peered":"2024-09-17T04:09:45.381675+0000","last_clean":"2024-09-17T04:09:45.381675+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:09:45.381675+0000","last_undegraded":"2024-09-17T04:09:45.381675+0000","last_fullsized":"2024-09-17T04:09:45.381675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489776+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:09:45.489776+0000","last_peered":"2024-09-17T04:09:45.489776+0000","last_clean":"2024-09-17T04:09:45.489776+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:09:45.489776+0000","last_undegraded":"2024-09-17T04:09:45.489776+0000","last_fullsized":"2024-09-17T04:09:45.489776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487117+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:09:45.487117+0000","last_peered":"2024-09-17T04:09:45.487117+0000","last_clean":"2024-09-17T04:09:45.487117+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:09:45.487117+0000","last_undegraded":"2024-09-17T04:09:45.487117+0000","last_fullsized":"2024-09-17T04:09:45.487117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489018+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:09:45.489018+0000","last_peered":"2024-09-17T04:09:45.489018+0000","last_clean":"2024-09-17T04:09:45.489018+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:09:45.489018+0000","last_undegraded":"2024-09-17T04:09:45.489018+0000","last_fullsized":"2024-09-17T04:09:45.489018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.382031+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:09:45.382031+0000","last_peered":"2024-09-17T04:09:45.382031+0000","last_clean":"2024-09-17T04:09:45.382031+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:09:45.382031+0000","last_undegraded":"2024-09-17T04:09:45.382031+0000","last_fullsized":"2024-09-17T04:09:45.382031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486989+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:09:45.486989+0000","last_peered":"2024-09-17T04:09:45.486989+0000","last_clean":"2024-09-17T04:09:45.486989+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:09:45.486989+0000","last_undegraded":"2024-09-17T04:09:45.486989+0000","last_fullsized":"2024-09-17T04:09:45.486989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379739+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:09:45.379739+0000","last_peered":"2024-09-17T04:09:45.379739+0000","last_clean":"2024-09-17T04:09:45.379739+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:09:45.379739+0000","last_undegraded":"2024-09-17T04:09:45.379739+0000","last_fullsized":"2024-09-17T04:09:45.379739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488557+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:09:45.488557+0000","last_peered":"2024-09-17T04:09:45.488557+0000","last_clean":"2024-09-17T04:09:45.488557+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:09:45.488557+0000","last_undegraded":"2024-09-17T04:09:45.488557+0000","last_fullsized":"2024-09-17T04:09:45.488557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381554+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:09:45.381554+0000","last_peered":"2024-09-17T04:09:45.381554+0000","last_clean":"2024-09-17T04:09:45.381554+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:09:45.381554+0000","last_undegraded":"2024-09-17T04:09:45.381554+0000","last_fullsized":"2024-09-17T04:09:45.381554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381830+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:09:45.381830+0000","last_peered":"2024-09-17T04:09:45.381830+0000","last_clean":"2024-09-17T04:09:45.381830+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:09:45.381830+0000","last_undegraded":"2024-09-17T04:09:45.381830+0000","last_fullsized":"2024-09-17T04:09:45.381830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488750+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:09:45.488750+0000","last_peered":"2024-09-17T04:09:45.488750+0000","last_clean":"2024-09-17T04:09:45.488750+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:09:45.488750+0000","last_undegraded":"2024-09-17T04:09:45.488750+0000","last_fullsized":"2024-09-17T04:09:45.488750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489146+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:09:45.489146+0000","last_peered":"2024-09-17T04:09:45.489146+0000","last_clean":"2024-09-17T04:09:45.489146+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:09:45.489146+0000","last_undegraded":"2024-09-17T04:09:45.489146+0000","last_fullsized":"2024-09-17T04:09:45.489146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489258+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:09:45.489258+0000","last_peered":"2024-09-17T04:09:45.489258+0000","last_clean":"2024-09-17T04:09:45.489258+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:09:45.489258+0000","last_undegraded":"2024-09-17T04:09:45.489258+0000","last_fullsized":"2024-09-17T04:09:45.489258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489441+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:09:45.489441+0000","last_peered":"2024-09-17T04:09:45.489441+0000","last_clean":"2024-09-17T04:09:45.489441+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:09:45.489441+0000","last_undegraded":"2024-09-17T04:09:45.489441+0000","last_fullsized":"2024-09-17T04:09:45.489441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488314+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:09:45.488314+0000","last_peered":"2024-09-17T04:09:45.488314+0000","last_clean":"2024-09-17T04:09:45.488314+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:09:45.488314+0000","last_undegraded":"2024-09-17T04:09:45.488314+0000","last_fullsized":"2024-09-17T04:09:45.488314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487080+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:09:45.487080+0000","last_peered":"2024-09-17T04:09:45.487080+0000","last_clean":"2024-09-17T04:09:45.487080+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:09:45.487080+0000","last_undegraded":"2024-09-17T04:09:45.487080+0000","last_fullsized":"2024-09-17T04:09:45.487080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488377+0000","last_change":"2024-09-17T04:09:40.352259+0000","last_active":"2024-09-17T04:09:45.488377+0000","last_peered":"2024-09-17T04:09:45.488377+0000","last_clean":"2024-09-17T04:09:45.488377+0000","last_became_active":"2024-09-17T04:09:40.351940+0000","last_became_peered":"2024-09-17T04:09:40.351940+0000","last_unstale":"2024-09-17T04:09:45.488377+0000","last_undegraded":"2024-09-17T04:09:45.488377+0000","last_fullsized":"2024-09-17T04:09:45.488377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489543+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:09:45.489543+0000","last_peered":"2024-09-17T04:09:45.489543+0000","last_clean":"2024-09-17T04:09:45.489543+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:09:45.489543+0000","last_undegraded":"2024-09-17T04:09:45.489543+0000","last_fullsized":"2024-09-17T04:09:45.489543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488788+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:09:45.488788+0000","last_peered":"2024-09-17T04:09:45.488788+0000","last_clean":"2024-09-17T04:09:45.488788+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:09:45.488788+0000","last_undegraded":"2024-09-17T04:09:45.488788+0000","last_fullsized":"2024-09-17T04:09:45.488788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381892+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:09:45.381892+0000","last_peered":"2024-09-17T04:09:45.381892+0000","last_clean":"2024-09-17T04:09:45.381892+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:09:45.381892+0000","last_undegraded":"2024-09-17T04:09:45.381892+0000","last_fullsized":"2024-09-17T04:09:45.381892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488433+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:09:45.488433+0000","last_peered":"2024-09-17T04:09:45.488433+0000","last_clean":"2024-09-17T04:09:45.488433+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:09:45.488433+0000","last_undegraded":"2024-09-17T04:09:45.488433+0000","last_fullsized":"2024-09-17T04:09:45.488433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489278+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:09:45.489278+0000","last_peered":"2024-09-17T04:09:45.489278+0000","last_clean":"2024-09-17T04:09:45.489278+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:09:45.489278+0000","last_undegraded":"2024-09-17T04:09:45.489278+0000","last_fullsized":"2024-09-17T04:09:45.489278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487967+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:09:45.487967+0000","last_peered":"2024-09-17T04:09:45.487967+0000","last_clean":"2024-09-17T04:09:45.487967+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:09:45.487967+0000","last_undegraded":"2024-09-17T04:09:45.487967+0000","last_fullsized":"2024-09-17T04:09:45.487967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376260+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:09:45.376260+0000","last_peered":"2024-09-17T04:09:45.376260+0000","last_clean":"2024-09-17T04:09:45.376260+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:09:45.376260+0000","last_undegraded":"2024-09-17T04:09:45.376260+0000","last_fullsized":"2024-09-17T04:09:45.376260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488812+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:09:45.488812+0000","last_peered":"2024-09-17T04:09:45.488812+0000","last_clean":"2024-09-17T04:09:45.488812+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:09:45.488812+0000","last_undegraded":"2024-09-17T04:09:45.488812+0000","last_fullsized":"2024-09-17T04:09:45.488812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486751+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:09:45.486751+0000","last_peered":"2024-09-17T04:09:45.486751+0000","last_clean":"2024-09-17T04:09:45.486751+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:09:45.486751+0000","last_undegraded":"2024-09-17T04:09:45.486751+0000","last_fullsized":"2024-09-17T04:09:45.486751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486996+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:09:45.486996+0000","last_peered":"2024-09-17T04:09:45.486996+0000","last_clean":"2024-09-17T04:09:45.486996+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:09:45.486996+0000","last_undegraded":"2024-09-17T04:09:45.486996+0000","last_fullsized":"2024-09-17T04:09:45.486996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488479+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:09:45.488479+0000","last_peered":"2024-09-17T04:09:45.488479+0000","last_clean":"2024-09-17T04:09:45.488479+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:09:45.488479+0000","last_undegraded":"2024-09-17T04:09:45.488479+0000","last_fullsized":"2024-09-17T04:09:45.488479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487202+0000","last_change":"2024-09-17T04:09:40.352550+0000","last_active":"2024-09-17T04:09:45.487202+0000","last_peered":"2024-09-17T04:09:45.487202+0000","last_clean":"2024-09-17T04:09:45.487202+0000","last_became_active":"2024-09-17T04:09:40.352245+0000","last_became_peered":"2024-09-17T04:09:40.352245+0000","last_unstale":"2024-09-17T04:09:45.487202+0000","last_undegraded":"2024-09-17T04:09:45.487202+0000","last_fullsized":"2024-09-17T04:09:45.487202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:30.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487781+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:09:45.487781+0000","last_peered":"2024-09-17T04:09:45.487781+0000","last_clean":"2024-09-17T04:09:45.487781+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:09:45.487781+0000","last_undegraded":"2024-09-17T04:09:45.487781+0000","last_fullsized":"2024-09-17T04:09:45.487781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487130+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:09:45.487130+0000","last_peered":"2024-09-17T04:09:45.487130+0000","last_clean":"2024-09-17T04:09:45.487130+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:09:45.487130+0000","last_undegraded":"2024-09-17T04:09:45.487130+0000","last_fullsized":"2024-09-17T04:09:45.487130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380658+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:09:45.380658+0000","last_peered":"2024-09-17T04:09:45.380658+0000","last_clean":"2024-09-17T04:09:45.380658+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:09:45.380658+0000","last_undegraded":"2024-09-17T04:09:45.380658+0000","last_fullsized":"2024-09-17T04:09:45.380658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487996+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:09:45.487996+0000","last_peered":"2024-09-17T04:09:45.487996+0000","last_clean":"2024-09-17T04:09:45.487996+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:09:45.487996+0000","last_undegraded":"2024-09-17T04:09:45.487996+0000","last_fullsized":"2024-09-17T04:09:45.487996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376608+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:09:45.376608+0000","last_peered":"2024-09-17T04:09:45.376608+0000","last_clean":"2024-09-17T04:09:45.376608+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:09:45.376608+0000","last_undegraded":"2024-09-17T04:09:45.376608+0000","last_fullsized":"2024-09-17T04:09:45.376608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379735+0000","last_change":"2024-09-17T04:09:44.490924+0000","last_active":"2024-09-17T04:09:45.379735+0000","last_peered":"2024-09-17T04:09:45.379735+0000","last_clean":"2024-09-17T04:09:45.379735+0000","last_became_active":"2024-09-17T04:09:44.490464+0000","last_became_peered":"2024-09-17T04:09:44.490464+0000","last_unstale":"2024-09-17T04:09:45.379735+0000","last_undegraded":"2024-09-17T04:09:45.379735+0000","last_fullsized":"2024-09-17T04:09:45.379735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:07.828382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488305+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:09:45.488305+0000","last_peered":"2024-09-17T04:09:45.488305+0000","last_clean":"2024-09-17T04:09:45.488305+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:09:45.488305+0000","last_undegraded":"2024-09-17T04:09:45.488305+0000","last_fullsized":"2024-09-17T04:09:45.488305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488284+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:09:45.488284+0000","last_peered":"2024-09-17T04:09:45.488284+0000","last_clean":"2024-09-17T04:09:45.488284+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:09:45.488284+0000","last_undegraded":"2024-09-17T04:09:45.488284+0000","last_fullsized":"2024-09-17T04:09:45.488284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487424+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:09:45.487424+0000","last_peered":"2024-09-17T04:09:45.487424+0000","last_clean":"2024-09-17T04:09:45.487424+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:09:45.487424+0000","last_undegraded":"2024-09-17T04:09:45.487424+0000","last_fullsized":"2024-09-17T04:09:45.487424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488308+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:09:45.488308+0000","last_peered":"2024-09-17T04:09:45.488308+0000","last_clean":"2024-09-17T04:09:45.488308+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:09:45.488308+0000","last_undegraded":"2024-09-17T04:09:45.488308+0000","last_fullsized":"2024-09-17T04:09:45.488308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376681+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:09:45.376681+0000","last_peered":"2024-09-17T04:09:45.376681+0000","last_clean":"2024-09-17T04:09:45.376681+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:09:45.376681+0000","last_undegraded":"2024-09-17T04:09:45.376681+0000","last_fullsized":"2024-09-17T04:09:45.376681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486994+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:09:45.486994+0000","last_peered":"2024-09-17T04:09:45.486994+0000","last_clean":"2024-09-17T04:09:45.486994+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:09:45.486994+0000","last_undegraded":"2024-09-17T04:09:45.486994+0000","last_fullsized":"2024-09-17T04:09:45.486994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488529+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:09:45.488529+0000","last_peered":"2024-09-17T04:09:45.488529+0000","last_clean":"2024-09-17T04:09:45.488529+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:09:45.488529+0000","last_undegraded":"2024-09-17T04:09:45.488529+0000","last_fullsized":"2024-09-17T04:09:45.488529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381107+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:09:45.381107+0000","last_peered":"2024-09-17T04:09:45.381107+0000","last_clean":"2024-09-17T04:09:45.381107+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:09:45.381107+0000","last_undegraded":"2024-09-17T04:09:45.381107+0000","last_fullsized":"2024-09-17T04:09:45.381107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380901+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:09:45.380901+0000","last_peered":"2024-09-17T04:09:45.380901+0000","last_clean":"2024-09-17T04:09:45.380901+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:09:45.380901+0000","last_undegraded":"2024-09-17T04:09:45.380901+0000","last_fullsized":"2024-09-17T04:09:45.380901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487226+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:09:45.487226+0000","last_peered":"2024-09-17T04:09:45.487226+0000","last_clean":"2024-09-17T04:09:45.487226+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:09:45.487226+0000","last_undegraded":"2024-09-17T04:09:45.487226+0000","last_fullsized":"2024-09-17T04:09:45.487226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376124+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:09:45.376124+0000","last_peered":"2024-09-17T04:09:45.376124+0000","last_clean":"2024-09-17T04:09:45.376124+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:09:45.376124+0000","last_undegraded":"2024-09-17T04:09:45.376124+0000","last_fullsized":"2024-09-17T04:09:45.376124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488264+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:09:45.488264+0000","last_peered":"2024-09-17T04:09:45.488264+0000","last_clean":"2024-09-17T04:09:45.488264+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:09:45.488264+0000","last_undegraded":"2024-09-17T04:09:45.488264+0000","last_fullsized":"2024-09-17T04:09:45.488264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379655+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:09:45.379655+0000","last_peered":"2024-09-17T04:09:45.379655+0000","last_clean":"2024-09-17T04:09:45.379655+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:09:45.379655+0000","last_undegraded":"2024-09-17T04:09:45.379655+0000","last_fullsized":"2024-09-17T04:09:45.379655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379962+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:09:45.379962+0000","last_peered":"2024-09-17T04:09:45.379962+0000","last_clean":"2024-09-17T04:09:45.379962+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:09:45.379962+0000","last_undegraded":"2024-09-17T04:09:45.379962+0000","last_fullsized":"2024-09-17T04:09:45.379962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488461+0000","last_change":"2024-09-17T04:09:44.494839+0000","last_active":"2024-09-17T04:09:45.488461+0000","last_peered":"2024-09-17T04:09:45.488461+0000","last_clean":"2024-09-17T04:09:45.488461+0000","last_became_active":"2024-09-17T04:09:44.494396+0000","last_became_peered":"2024-09-17T04:09:44.494396+0000","last_unstale":"2024-09-17T04:09:45.488461+0000","last_undegraded":"2024-09-17T04:09:45.488461+0000","last_fullsized":"2024-09-17T04:09:45.488461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:45.786583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487743+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:09:45.487743+0000","last_peered":"2024-09-17T04:09:45.487743+0000","last_clean":"2024-09-17T04:09:45.487743+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:09:45.487743+0000","last_undegraded":"2024-09-17T04:09:45.487743+0000","last_fullsized":"2024-09-17T04:09:45.487743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488322+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:09:45.488322+0000","last_peered":"2024-09-17T04:09:45.488322+0000","last_clean":"2024-09-17T04:09:45.488322+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:09:45.488322+0000","last_undegraded":"2024-09-17T04:09:45.488322+0000","last_fullsized":"2024-09-17T04:09:45.488322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489197+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:09:45.489197+0000","last_peered":"2024-09-17T04:09:45.489197+0000","last_clean":"2024-09-17T04:09:45.489197+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:09:45.489197+0000","last_undegraded":"2024-09-17T04:09:45.489197+0000","last_fullsized":"2024-09-17T04:09:45.489197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487785+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:09:45.487785+0000","last_peered":"2024-09-17T04:09:45.487785+0000","last_clean":"2024-09-17T04:09:45.487785+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:09:45.487785+0000","last_undegraded":"2024-09-17T04:09:45.487785+0000","last_fullsized":"2024-09-17T04:09:45.487785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488190+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:09:45.488190+0000","last_peered":"2024-09-17T04:09:45.488190+0000","last_clean":"2024-09-17T04:09:45.488190+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:09:45.488190+0000","last_undegraded":"2024-09-17T04:09:45.488190+0000","last_fullsized":"2024-09-17T04:09:45.488190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487532+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:09:45.487532+0000","last_peered":"2024-09-17T04:09:45.487532+0000","last_clean":"2024-09-17T04:09:45.487532+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:09:45.487532+0000","last_undegraded":"2024-09-17T04:09:45.487532+0000","last_fullsized":"2024-09-17T04:09:45.487532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:49.910746+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:09:49.910746+0000","last_peered":"2024-09-17T04:09:49.910746+0000","last_clean":"2024-09-17T04:09:49.910746+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:09:49.910746+0000","last_undegraded":"2024-09-17T04:09:49.910746+0000","last_fullsized":"2024-09-17T04:09:49.910746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488917+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:09:45.488917+0000","last_peered":"2024-09-17T04:09:45.488917+0000","last_clean":"2024-09-17T04:09:45.488917+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:09:45.488917+0000","last_undegraded":"2024-09-17T04:09:45.488917+0000","last_fullsized":"2024-09-17T04:09:45.488917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381857+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:09:45.381857+0000","last_peered":"2024-09-17T04:09:45.381857+0000","last_clean":"2024-09-17T04:09:45.381857+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:09:45.381857+0000","last_undegraded":"2024-09-17T04:09:45.381857+0000","last_fullsized":"2024-09-17T04:09:45.381857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488252+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:09:45.488252+0000","last_peered":"2024-09-17T04:09:45.488252+0000","last_clean":"2024-09-17T04:09:45.488252+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:09:45.488252+0000","last_undegraded":"2024-09-17T04:09:45.488252+0000","last_fullsized":"2024-09-17T04:09:45.488252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381469+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:09:45.381469+0000","last_peered":"2024-09-17T04:09:45.381469+0000","last_clean":"2024-09-17T04:09:45.381469+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:09:45.381469+0000","last_undegraded":"2024-09-17T04:09:45.381469+0000","last_fullsized":"2024-09-17T04:09:45.381469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488076+0000","last_change":"2024-09-17T04:09:40.340531+0000","last_active":"2024-09-17T04:09:45.488076+0000","last_peered":"2024-09-17T04:09:45.488076+0000","last_clean":"2024-09-17T04:09:45.488076+0000","last_became_active":"2024-09-17T04:09:40.340218+0000","last_became_peered":"2024-09-17T04:09:40.340218+0000","last_unstale":"2024-09-17T04:09:45.488076+0000","last_undegraded":"2024-09-17T04:09:45.488076+0000","last_fullsized":"2024-09-17T04:09:45.488076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488153+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:09:45.488153+0000","last_peered":"2024-09-17T04:09:45.488153+0000","last_clean":"2024-09-17T04:09:45.488153+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:09:45.488153+0000","last_undegraded":"2024-09-17T04:09:45.488153+0000","last_fullsized":"2024-09-17T04:09:45.488153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489688+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:09:45.489688+0000","last_peered":"2024-09-17T04:09:45.489688+0000","last_clean":"2024-09-17T04:09:45.489688+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:09:45.489688+0000","last_undegraded":"2024-09-17T04:09:45.489688+0000","last_fullsized":"2024-09-17T04:09:45.489688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488106+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:09:45.488106+0000","last_peered":"2024-09-17T04:09:45.488106+0000","last_clean":"2024-09-17T04:09:45.488106+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:09:45.488106+0000","last_undegraded":"2024-09-17T04:09:45.488106+0000","last_fullsized":"2024-09-17T04:09:45.488106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381382+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:09:45.381382+0000","last_peered":"2024-09-17T04:09:45.381382+0000","last_clean":"2024-09-17T04:09:45.381382+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:09:45.381382+0000","last_undegraded":"2024-09-17T04:09:45.381382+0000","last_fullsized":"2024-09-17T04:09:45.381382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488352+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:09:45.488352+0000","last_peered":"2024-09-17T04:09:45.488352+0000","last_clean":"2024-09-17T04:09:45.488352+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:09:45.488352+0000","last_undegraded":"2024-09-17T04:09:45.488352+0000","last_fullsized":"2024-09-17T04:09:45.488352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488015+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:09:45.488015+0000","last_peered":"2024-09-17T04:09:45.488015+0000","last_clean":"2024-09-17T04:09:45.488015+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:09:45.488015+0000","last_undegraded":"2024-09-17T04:09:45.488015+0000","last_fullsized":"2024-09-17T04:09:45.488015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486906+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:09:45.486906+0000","last_peered":"2024-09-17T04:09:45.486906+0000","last_clean":"2024-09-17T04:09:45.486906+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:09:45.486906+0000","last_undegraded":"2024-09-17T04:09:45.486906+0000","last_fullsized":"2024-09-17T04:09:45.486906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487276+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:09:45.487276+0000","last_peered":"2024-09-17T04:09:45.487276+0000","last_clean":"2024-09-17T04:09:45.487276+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:09:45.487276+0000","last_undegraded":"2024-09-17T04:09:45.487276+0000","last_fullsized":"2024-09-17T04:09:45.487276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381357+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:09:45.381357+0000","last_peered":"2024-09-17T04:09:45.381357+0000","last_clean":"2024-09-17T04:09:45.381357+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:09:45.381357+0000","last_undegraded":"2024-09-17T04:09:45.381357+0000","last_fullsized":"2024-09-17T04:09:45.381357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489675+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:09:45.489675+0000","last_peered":"2024-09-17T04:09:45.489675+0000","last_clean":"2024-09-17T04:09:45.489675+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:09:45.489675+0000","last_undegraded":"2024-09-17T04:09:45.489675+0000","last_fullsized":"2024-09-17T04:09:45.489675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488762+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:09:45.488762+0000","last_peered":"2024-09-17T04:09:45.488762+0000","last_clean":"2024-09-17T04:09:45.488762+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:09:45.488762+0000","last_undegraded":"2024-09-17T04:09:45.488762+0000","last_fullsized":"2024-09-17T04:09:45.488762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380081+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:09:45.380081+0000","last_peered":"2024-09-17T04:09:45.380081+0000","last_clean":"2024-09-17T04:09:45.380081+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:09:45.380081+0000","last_undegraded":"2024-09-17T04:09:45.380081+0000","last_fullsized":"2024-09-17T04:09:45.380081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487686+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:09:45.487686+0000","last_peered":"2024-09-17T04:09:45.487686+0000","last_clean":"2024-09-17T04:09:45.487686+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:09:45.487686+0000","last_undegraded":"2024-09-17T04:09:45.487686+0000","last_fullsized":"2024-09-17T04:09:45.487686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376474+0000","last_change":"2024-09-17T04:09:44.390631+0000","last_active":"2024-09-17T04:09:45.376474+0000","last_peered":"2024-09-17T04:09:45.376474+0000","last_clean":"2024-09-17T04:09:45.376474+0000","last_became_active":"2024-09-17T04:09:44.390199+0000","last_became_peered":"2024-09-17T04:09:44.390199+0000","last_unstale":"2024-09-17T04:09:45.376474+0000","last_undegraded":"2024-09-17T04:09:45.376474+0000","last_fullsized":"2024-09-17T04:09:45.376474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:45.662654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487776+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:09:45.487776+0000","last_peered":"2024-09-17T04:09:45.487776+0000","last_clean":"2024-09-17T04:09:45.487776+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:09:45.487776+0000","last_undegraded":"2024-09-17T04:09:45.487776+0000","last_fullsized":"2024-09-17T04:09:45.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380623+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:09:45.380623+0000","last_peered":"2024-09-17T04:09:45.380623+0000","last_clean":"2024-09-17T04:09:45.380623+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:09:45.380623+0000","last_undegraded":"2024-09-17T04:09:45.380623+0000","last_fullsized":"2024-09-17T04:09:45.380623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487823+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:09:45.487823+0000","last_peered":"2024-09-17T04:09:45.487823+0000","last_clean":"2024-09-17T04:09:45.487823+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:09:45.487823+0000","last_undegraded":"2024-09-17T04:09:45.487823+0000","last_fullsized":"2024-09-17T04:09:45.487823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379391+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:09:45.379391+0000","last_peered":"2024-09-17T04:09:45.379391+0000","last_clean":"2024-09-17T04:09:45.379391+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:09:45.379391+0000","last_undegraded":"2024-09-17T04:09:45.379391+0000","last_fullsized":"2024-09-17T04:09:45.379391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376223+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:09:45.376223+0000","last_peered":"2024-09-17T04:09:45.376223+0000","last_clean":"2024-09-17T04:09:45.376223+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:09:45.376223+0000","last_undegraded":"2024-09-17T04:09:45.376223+0000","last_fullsized":"2024-09-17T04:09:45.376223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488269+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:09:45.488269+0000","last_peered":"2024-09-17T04:09:45.488269+0000","last_clean":"2024-09-17T04:09:45.488269+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:09:45.488269+0000","last_undegraded":"2024-09-17T04:09:45.488269+0000","last_fullsized":"2024-09-17T04:09:45.488269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487587+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:09:45.487587+0000","last_peered":"2024-09-17T04:09:45.487587+0000","last_clean":"2024-09-17T04:09:45.487587+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:09:45.487587+0000","last_undegraded":"2024-09-17T04:09:45.487587+0000","last_fullsized":"2024-09-17T04:09:45.487587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489584+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:09:45.489584+0000","last_peered":"2024-09-17T04:09:45.489584+0000","last_clean":"2024-09-17T04:09:45.489584+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:09:45.489584+0000","last_undegraded":"2024-09-17T04:09:45.489584+0000","last_fullsized":"2024-09-17T04:09:45.489584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381271+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:09:45.381271+0000","last_peered":"2024-09-17T04:09:45.381271+0000","last_clean":"2024-09-17T04:09:45.381271+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:09:45.381271+0000","last_undegraded":"2024-09-17T04:09:45.381271+0000","last_fullsized":"2024-09-17T04:09:45.381271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488639+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:09:45.488639+0000","last_peered":"2024-09-17T04:09:45.488639+0000","last_clean":"2024-09-17T04:09:45.488639+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:09:45.488639+0000","last_undegraded":"2024-09-17T04:09:45.488639+0000","last_fullsized":"2024-09-17T04:09:45.488639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487577+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:09:45.487577+0000","last_peered":"2024-09-17T04:09:45.487577+0000","last_clean":"2024-09-17T04:09:45.487577+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:09:45.487577+0000","last_undegraded":"2024-09-17T04:09:45.487577+0000","last_fullsized":"2024-09-17T04:09:45.487577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488654+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:09:45.488654+0000","last_peered":"2024-09-17T04:09:45.488654+0000","last_clean":"2024-09-17T04:09:45.488654+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:09:45.488654+0000","last_undegraded":"2024-09-17T04:09:45.488654+0000","last_fullsized":"2024-09-17T04:09:45.488654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487259+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:09:45.487259+0000","last_peered":"2024-09-17T04:09:45.487259+0000","last_clean":"2024-09-17T04:09:45.487259+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:09:45.487259+0000","last_undegraded":"2024-09-17T04:09:45.487259+0000","last_fullsized":"2024-09-17T04:09:45.487259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380298+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:09:45.380298+0000","last_peered":"2024-09-17T04:09:45.380298+0000","last_clean":"2024-09-17T04:09:45.380298+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:09:45.380298+0000","last_undegraded":"2024-09-17T04:09:45.380298+0000","last_fullsized":"2024-09-17T04:09:45.380298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488632+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:09:45.488632+0000","last_peered":"2024-09-17T04:09:45.488632+0000","last_clean":"2024-09-17T04:09:45.488632+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:09:45.488632+0000","last_undegraded":"2024-09-17T04:09:45.488632+0000","last_fullsized":"2024-09-17T04:09:45.488632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376559+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:09:45.376559+0000","last_peered":"2024-09-17T04:09:45.376559+0000","last_clean":"2024-09-17T04:09:45.376559+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:09:45.376559+0000","last_undegraded":"2024-09-17T04:09:45.376559+0000","last_fullsized":"2024-09-17T04:09:45.376559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488714+0000","last_change":"2024-09-17T04:09:40.357971+0000","last_active":"2024-09-17T04:09:45.488714+0000","last_peered":"2024-09-17T04:09:45.488714+0000","last_clean":"2024-09-17T04:09:45.488714+0000","last_became_active":"2024-09-17T04:09:40.357694+0000","last_became_peered":"2024-09-17T04:09:40.357694+0000","last_unstale":"2024-09-17T04:09:45.488714+0000","last_undegraded":"2024-09-17T04:09:45.488714+0000","last_fullsized":"2024-09-17T04:09:45.488714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487015+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:09:45.487015+0000","last_peered":"2024-09-17T04:09:45.487015+0000","last_clean":"2024-09-17T04:09:45.487015+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:09:45.487015+0000","last_undegraded":"2024-09-17T04:09:45.487015+0000","last_fullsized":"2024-09-17T04:09:45.487015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487021+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:09:45.487021+0000","last_peered":"2024-09-17T04:09:45.487021+0000","last_clean":"2024-09-17T04:09:45.487021+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:09:45.487021+0000","last_undegraded":"2024-09-17T04:09:45.487021+0000","last_fullsized":"2024-09-17T04:09:45.487021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381785+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:09:45.381785+0000","last_peered":"2024-09-17T04:09:45.381785+0000","last_clean":"2024-09-17T04:09:45.381785+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:09:45.381785+0000","last_undegraded":"2024-09-17T04:09:45.381785+0000","last_fullsized":"2024-09-17T04:09:45.381785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380952+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:09:45.380952+0000","last_peered":"2024-09-17T04:09:45.380952+0000","last_clean":"2024-09-17T04:09:45.380952+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:09:45.380952+0000","last_undegraded":"2024-09-17T04:09:45.380952+0000","last_fullsized":"2024-09-17T04:09:45.380952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381260+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:09:45.381260+0000","last_peered":"2024-09-17T04:09:45.381260+0000","last_clean":"2024-09-17T04:09:45.381260+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:09:45.381260+0000","last_undegraded":"2024-09-17T04:09:45.381260+0000","last_fullsized":"2024-09-17T04:09:45.381260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488192+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:09:45.488192+0000","last_peered":"2024-09-17T04:09:45.488192+0000","last_clean":"2024-09-17T04:09:45.488192+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:09:45.488192+0000","last_undegraded":"2024-09-17T04:09:45.488192+0000","last_fullsized":"2024-09-17T04:09:45.488192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489513+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:09:45.489513+0000","last_peered":"2024-09-17T04:09:45.489513+0000","last_clean":"2024-09-17T04:09:45.489513+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:09:45.489513+0000","last_undegraded":"2024-09-17T04:09:45.489513+0000","last_fullsized":"2024-09-17T04:09:45.489513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487054+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:09:45.487054+0000","last_peered":"2024-09-17T04:09:45.487054+0000","last_clean":"2024-09-17T04:09:45.487054+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:09:45.487054+0000","last_undegraded":"2024-09-17T04:09:45.487054+0000","last_fullsized":"2024-09-17T04:09:45.487054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488027+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:09:45.488027+0000","last_peered":"2024-09-17T04:09:45.488027+0000","last_clean":"2024-09-17T04:09:45.488027+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:09:45.488027+0000","last_undegraded":"2024-09-17T04:09:45.488027+0000","last_fullsized":"2024-09-17T04:09:45.488027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487515+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:09:45.487515+0000","last_peered":"2024-09-17T04:09:45.487515+0000","last_clean":"2024-09-17T04:09:45.487515+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:09:45.487515+0000","last_undegraded":"2024-09-17T04:09:45.487515+0000","last_fullsized":"2024-09-17T04:09:45.487515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488105+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:09:45.488105+0000","last_peered":"2024-09-17T04:09:45.488105+0000","last_clean":"2024-09-17T04:09:45.488105+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:09:45.488105+0000","last_undegraded":"2024-09-17T04:09:45.488105+0000","last_fullsized":"2024-09-17T04:09:45.488105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487102+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:09:45.487102+0000","last_peered":"2024-09-17T04:09:45.487102+0000","last_clean":"2024-09-17T04:09:45.487102+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:09:45.487102+0000","last_undegraded":"2024-09-17T04:09:45.487102+0000","last_fullsized":"2024-09-17T04:09:45.487102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489059+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:09:45.489059+0000","last_peered":"2024-09-17T04:09:45.489059+0000","last_clean":"2024-09-17T04:09:45.489059+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:09:45.489059+0000","last_undegraded":"2024-09-17T04:09:45.489059+0000","last_fullsized":"2024-09-17T04:09:45.489059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488026+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:09:45.488026+0000","last_peered":"2024-09-17T04:09:45.488026+0000","last_clean":"2024-09-17T04:09:45.488026+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:09:45.488026+0000","last_undegraded":"2024-09-17T04:09:45.488026+0000","last_fullsized":"2024-09-17T04:09:45.488026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":702305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":111481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":111355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":702361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:09:59.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:09:59.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 -- 172.21.15.104:0/53685992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc0b3fc0 msgr2=0x7f72dc0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/53685992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc0b3fc0 0x7f72dc0b43d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72dc06e3e0 tx=0x7f72d002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 -- 172.21.15.104:0/53685992 shutdown_connections 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/53685992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc0b3fc0 0x7f72dc0b43d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 -- 172.21.15.104:0/53685992 >> 172.21.15.104:0/53685992 conn(0x7f72dc0b2cc0 msgr2=0x7f72dc0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 -- 172.21.15.104:0/53685992 shutdown_connections 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.386+0000 7f72e1d2b640 1 -- 172.21.15.104:0/53685992 wait complete. 2024-09-17T04:09:59.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.388+0000 7f72e1d2b640 1 Processor -- start 2024-09-17T04:09:59.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.388+0000 7f72e1d2b640 1 -- start start 2024-09-17T04:09:59.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 0x7f72dc0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 0x7f72dc1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15b960 con 0x7f72dc073d50 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15b7e0 con 0x7f72dc0d0b40 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc15bae0 con 0x7f72dc0b3fc0 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49166/0 (socket says 172.21.15.104:49166) 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 -- 172.21.15.104:0/3134576199 learned_addr learned my addr 172.21.15.104:0/3134576199 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72dbfff640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 0x7f72dc1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72daffd640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 0x7f72dc0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 -- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 msgr2=0x7f72dc0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 0x7f72dc0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 -- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 msgr2=0x7f72dc1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 0x7f72dc1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 -- 172.21.15.104:0/3134576199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc1f5150 con 0x7f72dc073d50 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72daffd640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 0x7f72dc0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72dbfff640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 0x7f72dc1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72db7fe640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c430 tx=0x7f72cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc017070 con 0x7f72dc073d50 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72cc0053e0 con 0x7f72dc073d50 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc1f8e90 con 0x7f72dc073d50 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc003850 con 0x7f72dc073d50 2024-09-17T04:09:59.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.390+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc1f9450 con 0x7f72dc073d50 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.392+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc15bfd0 con 0x7f72dc073d50 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.392+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72cc01a070 con 0x7f72dc073d50 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.392+0000 7f72c3fff640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 0x7f72c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.393+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f72cc09a4f0 con 0x7f72dc073d50 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.393+0000 7f72daffd640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 0x7f72c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.393+0000 7f72daffd640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 0x7f72c807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72d0033000 tx=0x7f72d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.397+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72dc1f5150 con 0x7f72dc073d50 2024-09-17T04:09:59.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.575+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72dc0744a0 con 0x7f72c8078b90 2024-09-17T04:09:59.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.581+0000 7f72c3fff640 1 -- 172.21.15.104:0/3134576199 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f72dc0744a0 con 0x7f72c8078b90 2024-09-17T04:09:59.584 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:59.586 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 msgr2=0x7f72c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 0x7f72c807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72d0033000 tx=0x7f72d0004730 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 msgr2=0x7f72dc0cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c430 tx=0x7f72cc00c8f0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 shutdown_connections 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f72c8078b90 0x7f72c807b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72dc0d0b40 0x7f72dc1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72dc0b3fc0 0x7f72dc0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 --2- 172.21.15.104:0/3134576199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72dc073d50 0x7f72dc0cc5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 >> 172.21.15.104:0/3134576199 conn(0x7f72dc0b2cc0 msgr2=0x7f72dc154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.585+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 shutdown_connections 2024-09-17T04:09:59.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.586+0000 7f72e1d2b640 1 -- 172.21.15.104:0/3134576199 wait complete. 2024-09-17T04:09:59.597 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-17T04:09:59.348066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219668,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755052,"statfs":{"total":773094113280,"available":772869173248,"internally_reserved":0,"allocated":3514368,"data_stored":2080856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003643"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488204+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:09:45.488204+0000","last_peered":"2024-09-17T04:09:45.488204+0000","last_clean":"2024-09-17T04:09:45.488204+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:09:45.488204+0000","last_undegraded":"2024-09-17T04:09:45.488204+0000","last_fullsized":"2024-09-17T04:09:45.488204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487142+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:09:45.487142+0000","last_peered":"2024-09-17T04:09:45.487142+0000","last_clean":"2024-09-17T04:09:45.487142+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:09:45.487142+0000","last_undegraded":"2024-09-17T04:09:45.487142+0000","last_fullsized":"2024-09-17T04:09:45.487142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488102+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:09:45.488102+0000","last_peered":"2024-09-17T04:09:45.488102+0000","last_clean":"2024-09-17T04:09:45.488102+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:09:45.488102+0000","last_undegraded":"2024-09-17T04:09:45.488102+0000","last_fullsized":"2024-09-17T04:09:45.488102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487419+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:09:45.487419+0000","last_peered":"2024-09-17T04:09:45.487419+0000","last_clean":"2024-09-17T04:09:45.487419+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:09:45.487419+0000","last_undegraded":"2024-09-17T04:09:45.487419+0000","last_fullsized":"2024-09-17T04:09:45.487419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487870+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:09:45.487870+0000","last_peered":"2024-09-17T04:09:45.487870+0000","last_clean":"2024-09-17T04:09:45.487870+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:09:45.487870+0000","last_undegraded":"2024-09-17T04:09:45.487870+0000","last_fullsized":"2024-09-17T04:09:45.487870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381185+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:09:45.381185+0000","last_peered":"2024-09-17T04:09:45.381185+0000","last_clean":"2024-09-17T04:09:45.381185+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:09:45.381185+0000","last_undegraded":"2024-09-17T04:09:45.381185+0000","last_fullsized":"2024-09-17T04:09:45.381185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488189+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:09:45.488189+0000","last_peered":"2024-09-17T04:09:45.488189+0000","last_clean":"2024-09-17T04:09:45.488189+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:09:45.488189+0000","last_undegraded":"2024-09-17T04:09:45.488189+0000","last_fullsized":"2024-09-17T04:09:45.488189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488154+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:09:45.488154+0000","last_peered":"2024-09-17T04:09:45.488154+0000","last_clean":"2024-09-17T04:09:45.488154+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:09:45.488154+0000","last_undegraded":"2024-09-17T04:09:45.488154+0000","last_fullsized":"2024-09-17T04:09:45.488154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380765+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:09:45.380765+0000","last_peered":"2024-09-17T04:09:45.380765+0000","last_clean":"2024-09-17T04:09:45.380765+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:09:45.380765+0000","last_undegraded":"2024-09-17T04:09:45.380765+0000","last_fullsized":"2024-09-17T04:09:45.380765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488356+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:09:45.488356+0000","last_peered":"2024-09-17T04:09:45.488356+0000","last_clean":"2024-09-17T04:09:45.488356+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:09:45.488356+0000","last_undegraded":"2024-09-17T04:09:45.488356+0000","last_fullsized":"2024-09-17T04:09:45.488356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380259+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:09:45.380259+0000","last_peered":"2024-09-17T04:09:45.380259+0000","last_clean":"2024-09-17T04:09:45.380259+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:09:45.380259+0000","last_undegraded":"2024-09-17T04:09:45.380259+0000","last_fullsized":"2024-09-17T04:09:45.380259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380346+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:09:45.380346+0000","last_peered":"2024-09-17T04:09:45.380346+0000","last_clean":"2024-09-17T04:09:45.380346+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:09:45.380346+0000","last_undegraded":"2024-09-17T04:09:45.380346+0000","last_fullsized":"2024-09-17T04:09:45.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487865+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:09:45.487865+0000","last_peered":"2024-09-17T04:09:45.487865+0000","last_clean":"2024-09-17T04:09:45.487865+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:09:45.487865+0000","last_undegraded":"2024-09-17T04:09:45.487865+0000","last_fullsized":"2024-09-17T04:09:45.487865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379933+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:09:45.379933+0000","last_peered":"2024-09-17T04:09:45.379933+0000","last_clean":"2024-09-17T04:09:45.379933+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:09:45.379933+0000","last_undegraded":"2024-09-17T04:09:45.379933+0000","last_fullsized":"2024-09-17T04:09:45.379933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487666+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:09:45.487666+0000","last_peered":"2024-09-17T04:09:45.487666+0000","last_clean":"2024-09-17T04:09:45.487666+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:09:45.487666+0000","last_undegraded":"2024-09-17T04:09:45.487666+0000","last_fullsized":"2024-09-17T04:09:45.487666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489005+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:09:45.489005+0000","last_peered":"2024-09-17T04:09:45.489005+0000","last_clean":"2024-09-17T04:09:45.489005+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:09:45.489005+0000","last_undegraded":"2024-09-17T04:09:45.489005+0000","last_fullsized":"2024-09-17T04:09:45.489005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381675+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:09:45.381675+0000","last_peered":"2024-09-17T04:09:45.381675+0000","last_clean":"2024-09-17T04:09:45.381675+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:09:45.381675+0000","last_undegraded":"2024-09-17T04:09:45.381675+0000","last_fullsized":"2024-09-17T04:09:45.381675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489776+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:09:45.489776+0000","last_peered":"2024-09-17T04:09:45.489776+0000","last_clean":"2024-09-17T04:09:45.489776+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:09:45.489776+0000","last_undegraded":"2024-09-17T04:09:45.489776+0000","last_fullsized":"2024-09-17T04:09:45.489776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487117+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:09:45.487117+0000","last_peered":"2024-09-17T04:09:45.487117+0000","last_clean":"2024-09-17T04:09:45.487117+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:09:45.487117+0000","last_undegraded":"2024-09-17T04:09:45.487117+0000","last_fullsized":"2024-09-17T04:09:45.487117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489018+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:09:45.489018+0000","last_peered":"2024-09-17T04:09:45.489018+0000","last_clean":"2024-09-17T04:09:45.489018+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:09:45.489018+0000","last_undegraded":"2024-09-17T04:09:45.489018+0000","last_fullsized":"2024-09-17T04:09:45.489018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.382031+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:09:45.382031+0000","last_peered":"2024-09-17T04:09:45.382031+0000","last_clean":"2024-09-17T04:09:45.382031+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:09:45.382031+0000","last_undegraded":"2024-09-17T04:09:45.382031+0000","last_fullsized":"2024-09-17T04:09:45.382031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486989+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:09:45.486989+0000","last_peered":"2024-09-17T04:09:45.486989+0000","last_clean":"2024-09-17T04:09:45.486989+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:09:45.486989+0000","last_undegraded":"2024-09-17T04:09:45.486989+0000","last_fullsized":"2024-09-17T04:09:45.486989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379739+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:09:45.379739+0000","last_peered":"2024-09-17T04:09:45.379739+0000","last_clean":"2024-09-17T04:09:45.379739+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:09:45.379739+0000","last_undegraded":"2024-09-17T04:09:45.379739+0000","last_fullsized":"2024-09-17T04:09:45.379739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488557+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:09:45.488557+0000","last_peered":"2024-09-17T04:09:45.488557+0000","last_clean":"2024-09-17T04:09:45.488557+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:09:45.488557+0000","last_undegraded":"2024-09-17T04:09:45.488557+0000","last_fullsized":"2024-09-17T04:09:45.488557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381554+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:09:45.381554+0000","last_peered":"2024-09-17T04:09:45.381554+0000","last_clean":"2024-09-17T04:09:45.381554+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:09:45.381554+0000","last_undegraded":"2024-09-17T04:09:45.381554+0000","last_fullsized":"2024-09-17T04:09:45.381554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381830+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:09:45.381830+0000","last_peered":"2024-09-17T04:09:45.381830+0000","last_clean":"2024-09-17T04:09:45.381830+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:09:45.381830+0000","last_undegraded":"2024-09-17T04:09:45.381830+0000","last_fullsized":"2024-09-17T04:09:45.381830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488750+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:09:45.488750+0000","last_peered":"2024-09-17T04:09:45.488750+0000","last_clean":"2024-09-17T04:09:45.488750+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:09:45.488750+0000","last_undegraded":"2024-09-17T04:09:45.488750+0000","last_fullsized":"2024-09-17T04:09:45.488750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489146+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:09:45.489146+0000","last_peered":"2024-09-17T04:09:45.489146+0000","last_clean":"2024-09-17T04:09:45.489146+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:09:45.489146+0000","last_undegraded":"2024-09-17T04:09:45.489146+0000","last_fullsized":"2024-09-17T04:09:45.489146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489258+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:09:45.489258+0000","last_peered":"2024-09-17T04:09:45.489258+0000","last_clean":"2024-09-17T04:09:45.489258+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:09:45.489258+0000","last_undegraded":"2024-09-17T04:09:45.489258+0000","last_fullsized":"2024-09-17T04:09:45.489258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489441+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:09:45.489441+0000","last_peered":"2024-09-17T04:09:45.489441+0000","last_clean":"2024-09-17T04:09:45.489441+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:09:45.489441+0000","last_undegraded":"2024-09-17T04:09:45.489441+0000","last_fullsized":"2024-09-17T04:09:45.489441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488314+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:09:45.488314+0000","last_peered":"2024-09-17T04:09:45.488314+0000","last_clean":"2024-09-17T04:09:45.488314+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:09:45.488314+0000","last_undegraded":"2024-09-17T04:09:45.488314+0000","last_fullsized":"2024-09-17T04:09:45.488314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487080+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:09:45.487080+0000","last_peered":"2024-09-17T04:09:45.487080+0000","last_clean":"2024-09-17T04:09:45.487080+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:09:45.487080+0000","last_undegraded":"2024-09-17T04:09:45.487080+0000","last_fullsized":"2024-09-17T04:09:45.487080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488377+0000","last_change":"2024-09-17T04:09:40.352259+0000","last_active":"2024-09-17T04:09:45.488377+0000","last_peered":"2024-09-17T04:09:45.488377+0000","last_clean":"2024-09-17T04:09:45.488377+0000","last_became_active":"2024-09-17T04:09:40.351940+0000","last_became_peered":"2024-09-17T04:09:40.351940+0000","last_unstale":"2024-09-17T04:09:45.488377+0000","last_undegraded":"2024-09-17T04:09:45.488377+0000","last_fullsized":"2024-09-17T04:09:45.488377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489543+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:09:45.489543+0000","last_peered":"2024-09-17T04:09:45.489543+0000","last_clean":"2024-09-17T04:09:45.489543+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:09:45.489543+0000","last_undegraded":"2024-09-17T04:09:45.489543+0000","last_fullsized":"2024-09-17T04:09:45.489543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488788+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:09:45.488788+0000","last_peered":"2024-09-17T04:09:45.488788+0000","last_clean":"2024-09-17T04:09:45.488788+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:09:45.488788+0000","last_undegraded":"2024-09-17T04:09:45.488788+0000","last_fullsized":"2024-09-17T04:09:45.488788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381892+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:09:45.381892+0000","last_peered":"2024-09-17T04:09:45.381892+0000","last_clean":"2024-09-17T04:09:45.381892+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:09:45.381892+0000","last_undegraded":"2024-09-17T04:09:45.381892+0000","last_fullsized":"2024-09-17T04:09:45.381892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488433+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:09:45.488433+0000","last_peered":"2024-09-17T04:09:45.488433+0000","last_clean":"2024-09-17T04:09:45.488433+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:09:45.488433+0000","last_undegraded":"2024-09-17T04:09:45.488433+0000","last_fullsized":"2024-09-17T04:09:45.488433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489278+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:09:45.489278+0000","last_peered":"2024-09-17T04:09:45.489278+0000","last_clean":"2024-09-17T04:09:45.489278+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:09:45.489278+0000","last_undegraded":"2024-09-17T04:09:45.489278+0000","last_fullsized":"2024-09-17T04:09:45.489278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487967+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:09:45.487967+0000","last_peered":"2024-09-17T04:09:45.487967+0000","last_clean":"2024-09-17T04:09:45.487967+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:09:45.487967+0000","last_undegraded":"2024-09-17T04:09:45.487967+0000","last_fullsized":"2024-09-17T04:09:45.487967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376260+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:09:45.376260+0000","last_peered":"2024-09-17T04:09:45.376260+0000","last_clean":"2024-09-17T04:09:45.376260+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:09:45.376260+0000","last_undegraded":"2024-09-17T04:09:45.376260+0000","last_fullsized":"2024-09-17T04:09:45.376260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488812+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:09:45.488812+0000","last_peered":"2024-09-17T04:09:45.488812+0000","last_clean":"2024-09-17T04:09:45.488812+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:09:45.488812+0000","last_undegraded":"2024-09-17T04:09:45.488812+0000","last_fullsized":"2024-09-17T04:09:45.488812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486751+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:09:45.486751+0000","last_peered":"2024-09-17T04:09:45.486751+0000","last_clean":"2024-09-17T04:09:45.486751+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:09:45.486751+0000","last_undegraded":"2024-09-17T04:09:45.486751+0000","last_fullsized":"2024-09-17T04:09:45.486751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486996+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:09:45.486996+0000","last_peered":"2024-09-17T04:09:45.486996+0000","last_clean":"2024-09-17T04:09:45.486996+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:09:45.486996+0000","last_undegraded":"2024-09-17T04:09:45.486996+0000","last_fullsized":"2024-09-17T04:09:45.486996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488479+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:09:45.488479+0000","last_peered":"2024-09-17T04:09:45.488479+0000","last_clean":"2024-09-17T04:09:45.488479+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:09:45.488479+0000","last_undegraded":"2024-09-17T04:09:45.488479+0000","last_fullsized":"2024-09-17T04:09:45.488479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487202+0000","last_change":"2024-09-17T04:09:40.352550+0000","last_active":"2024-09-17T04:09:45.487202+0000","last_peered":"2024-09-17T04:09:45.487202+0000","last_clean":"2024-09-17T04:09:45.487202+0000","last_became_active":"2024-09-17T04:09:40.352245+0000","last_became_peered":"2024-09-17T04:09:40.352245+0000","last_unstale":"2024-09-17T04:09:45.487202+0000","last_undegraded":"2024-09-17T04:09:45.487202+0000","last_fullsized":"2024-09-17T04:09:45.487202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:30.497559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487781+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:09:45.487781+0000","last_peered":"2024-09-17T04:09:45.487781+0000","last_clean":"2024-09-17T04:09:45.487781+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:09:45.487781+0000","last_undegraded":"2024-09-17T04:09:45.487781+0000","last_fullsized":"2024-09-17T04:09:45.487781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487130+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:09:45.487130+0000","last_peered":"2024-09-17T04:09:45.487130+0000","last_clean":"2024-09-17T04:09:45.487130+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:09:45.487130+0000","last_undegraded":"2024-09-17T04:09:45.487130+0000","last_fullsized":"2024-09-17T04:09:45.487130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380658+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:09:45.380658+0000","last_peered":"2024-09-17T04:09:45.380658+0000","last_clean":"2024-09-17T04:09:45.380658+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:09:45.380658+0000","last_undegraded":"2024-09-17T04:09:45.380658+0000","last_fullsized":"2024-09-17T04:09:45.380658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487996+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:09:45.487996+0000","last_peered":"2024-09-17T04:09:45.487996+0000","last_clean":"2024-09-17T04:09:45.487996+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:09:45.487996+0000","last_undegraded":"2024-09-17T04:09:45.487996+0000","last_fullsized":"2024-09-17T04:09:45.487996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376608+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:09:45.376608+0000","last_peered":"2024-09-17T04:09:45.376608+0000","last_clean":"2024-09-17T04:09:45.376608+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:09:45.376608+0000","last_undegraded":"2024-09-17T04:09:45.376608+0000","last_fullsized":"2024-09-17T04:09:45.376608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379735+0000","last_change":"2024-09-17T04:09:44.490924+0000","last_active":"2024-09-17T04:09:45.379735+0000","last_peered":"2024-09-17T04:09:45.379735+0000","last_clean":"2024-09-17T04:09:45.379735+0000","last_became_active":"2024-09-17T04:09:44.490464+0000","last_became_peered":"2024-09-17T04:09:44.490464+0000","last_unstale":"2024-09-17T04:09:45.379735+0000","last_undegraded":"2024-09-17T04:09:45.379735+0000","last_fullsized":"2024-09-17T04:09:45.379735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:07.828382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488305+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:09:45.488305+0000","last_peered":"2024-09-17T04:09:45.488305+0000","last_clean":"2024-09-17T04:09:45.488305+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:09:45.488305+0000","last_undegraded":"2024-09-17T04:09:45.488305+0000","last_fullsized":"2024-09-17T04:09:45.488305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488284+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:09:45.488284+0000","last_peered":"2024-09-17T04:09:45.488284+0000","last_clean":"2024-09-17T04:09:45.488284+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:09:45.488284+0000","last_undegraded":"2024-09-17T04:09:45.488284+0000","last_fullsized":"2024-09-17T04:09:45.488284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487424+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:09:45.487424+0000","last_peered":"2024-09-17T04:09:45.487424+0000","last_clean":"2024-09-17T04:09:45.487424+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:09:45.487424+0000","last_undegraded":"2024-09-17T04:09:45.487424+0000","last_fullsized":"2024-09-17T04:09:45.487424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488308+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:09:45.488308+0000","last_peered":"2024-09-17T04:09:45.488308+0000","last_clean":"2024-09-17T04:09:45.488308+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:09:45.488308+0000","last_undegraded":"2024-09-17T04:09:45.488308+0000","last_fullsized":"2024-09-17T04:09:45.488308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376681+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:09:45.376681+0000","last_peered":"2024-09-17T04:09:45.376681+0000","last_clean":"2024-09-17T04:09:45.376681+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:09:45.376681+0000","last_undegraded":"2024-09-17T04:09:45.376681+0000","last_fullsized":"2024-09-17T04:09:45.376681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486994+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:09:45.486994+0000","last_peered":"2024-09-17T04:09:45.486994+0000","last_clean":"2024-09-17T04:09:45.486994+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:09:45.486994+0000","last_undegraded":"2024-09-17T04:09:45.486994+0000","last_fullsized":"2024-09-17T04:09:45.486994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488529+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:09:45.488529+0000","last_peered":"2024-09-17T04:09:45.488529+0000","last_clean":"2024-09-17T04:09:45.488529+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:09:45.488529+0000","last_undegraded":"2024-09-17T04:09:45.488529+0000","last_fullsized":"2024-09-17T04:09:45.488529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381107+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:09:45.381107+0000","last_peered":"2024-09-17T04:09:45.381107+0000","last_clean":"2024-09-17T04:09:45.381107+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:09:45.381107+0000","last_undegraded":"2024-09-17T04:09:45.381107+0000","last_fullsized":"2024-09-17T04:09:45.381107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380901+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:09:45.380901+0000","last_peered":"2024-09-17T04:09:45.380901+0000","last_clean":"2024-09-17T04:09:45.380901+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:09:45.380901+0000","last_undegraded":"2024-09-17T04:09:45.380901+0000","last_fullsized":"2024-09-17T04:09:45.380901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487226+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:09:45.487226+0000","last_peered":"2024-09-17T04:09:45.487226+0000","last_clean":"2024-09-17T04:09:45.487226+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:09:45.487226+0000","last_undegraded":"2024-09-17T04:09:45.487226+0000","last_fullsized":"2024-09-17T04:09:45.487226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376124+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:09:45.376124+0000","last_peered":"2024-09-17T04:09:45.376124+0000","last_clean":"2024-09-17T04:09:45.376124+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:09:45.376124+0000","last_undegraded":"2024-09-17T04:09:45.376124+0000","last_fullsized":"2024-09-17T04:09:45.376124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488264+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:09:45.488264+0000","last_peered":"2024-09-17T04:09:45.488264+0000","last_clean":"2024-09-17T04:09:45.488264+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:09:45.488264+0000","last_undegraded":"2024-09-17T04:09:45.488264+0000","last_fullsized":"2024-09-17T04:09:45.488264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379655+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:09:45.379655+0000","last_peered":"2024-09-17T04:09:45.379655+0000","last_clean":"2024-09-17T04:09:45.379655+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:09:45.379655+0000","last_undegraded":"2024-09-17T04:09:45.379655+0000","last_fullsized":"2024-09-17T04:09:45.379655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379962+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:09:45.379962+0000","last_peered":"2024-09-17T04:09:45.379962+0000","last_clean":"2024-09-17T04:09:45.379962+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:09:45.379962+0000","last_undegraded":"2024-09-17T04:09:45.379962+0000","last_fullsized":"2024-09-17T04:09:45.379962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488461+0000","last_change":"2024-09-17T04:09:44.494839+0000","last_active":"2024-09-17T04:09:45.488461+0000","last_peered":"2024-09-17T04:09:45.488461+0000","last_clean":"2024-09-17T04:09:45.488461+0000","last_became_active":"2024-09-17T04:09:44.494396+0000","last_became_peered":"2024-09-17T04:09:44.494396+0000","last_unstale":"2024-09-17T04:09:45.488461+0000","last_undegraded":"2024-09-17T04:09:45.488461+0000","last_fullsized":"2024-09-17T04:09:45.488461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:45.786583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487743+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:09:45.487743+0000","last_peered":"2024-09-17T04:09:45.487743+0000","last_clean":"2024-09-17T04:09:45.487743+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:09:45.487743+0000","last_undegraded":"2024-09-17T04:09:45.487743+0000","last_fullsized":"2024-09-17T04:09:45.487743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488322+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:09:45.488322+0000","last_peered":"2024-09-17T04:09:45.488322+0000","last_clean":"2024-09-17T04:09:45.488322+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:09:45.488322+0000","last_undegraded":"2024-09-17T04:09:45.488322+0000","last_fullsized":"2024-09-17T04:09:45.488322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489197+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:09:45.489197+0000","last_peered":"2024-09-17T04:09:45.489197+0000","last_clean":"2024-09-17T04:09:45.489197+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:09:45.489197+0000","last_undegraded":"2024-09-17T04:09:45.489197+0000","last_fullsized":"2024-09-17T04:09:45.489197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487667+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:09:45.487667+0000","last_peered":"2024-09-17T04:09:45.487667+0000","last_clean":"2024-09-17T04:09:45.487667+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:09:45.487667+0000","last_undegraded":"2024-09-17T04:09:45.487667+0000","last_fullsized":"2024-09-17T04:09:45.487667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487785+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:09:45.487785+0000","last_peered":"2024-09-17T04:09:45.487785+0000","last_clean":"2024-09-17T04:09:45.487785+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:09:45.487785+0000","last_undegraded":"2024-09-17T04:09:45.487785+0000","last_fullsized":"2024-09-17T04:09:45.487785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488190+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:09:45.488190+0000","last_peered":"2024-09-17T04:09:45.488190+0000","last_clean":"2024-09-17T04:09:45.488190+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:09:45.488190+0000","last_undegraded":"2024-09-17T04:09:45.488190+0000","last_fullsized":"2024-09-17T04:09:45.488190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487532+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:09:45.487532+0000","last_peered":"2024-09-17T04:09:45.487532+0000","last_clean":"2024-09-17T04:09:45.487532+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:09:45.487532+0000","last_undegraded":"2024-09-17T04:09:45.487532+0000","last_fullsized":"2024-09-17T04:09:45.487532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:49.910746+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:09:49.910746+0000","last_peered":"2024-09-17T04:09:49.910746+0000","last_clean":"2024-09-17T04:09:49.910746+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:09:49.910746+0000","last_undegraded":"2024-09-17T04:09:49.910746+0000","last_fullsized":"2024-09-17T04:09:49.910746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488917+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:09:45.488917+0000","last_peered":"2024-09-17T04:09:45.488917+0000","last_clean":"2024-09-17T04:09:45.488917+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:09:45.488917+0000","last_undegraded":"2024-09-17T04:09:45.488917+0000","last_fullsized":"2024-09-17T04:09:45.488917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381857+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:09:45.381857+0000","last_peered":"2024-09-17T04:09:45.381857+0000","last_clean":"2024-09-17T04:09:45.381857+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:09:45.381857+0000","last_undegraded":"2024-09-17T04:09:45.381857+0000","last_fullsized":"2024-09-17T04:09:45.381857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488252+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:09:45.488252+0000","last_peered":"2024-09-17T04:09:45.488252+0000","last_clean":"2024-09-17T04:09:45.488252+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:09:45.488252+0000","last_undegraded":"2024-09-17T04:09:45.488252+0000","last_fullsized":"2024-09-17T04:09:45.488252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381469+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:09:45.381469+0000","last_peered":"2024-09-17T04:09:45.381469+0000","last_clean":"2024-09-17T04:09:45.381469+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:09:45.381469+0000","last_undegraded":"2024-09-17T04:09:45.381469+0000","last_fullsized":"2024-09-17T04:09:45.381469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488076+0000","last_change":"2024-09-17T04:09:40.340531+0000","last_active":"2024-09-17T04:09:45.488076+0000","last_peered":"2024-09-17T04:09:45.488076+0000","last_clean":"2024-09-17T04:09:45.488076+0000","last_became_active":"2024-09-17T04:09:40.340218+0000","last_became_peered":"2024-09-17T04:09:40.340218+0000","last_unstale":"2024-09-17T04:09:45.488076+0000","last_undegraded":"2024-09-17T04:09:45.488076+0000","last_fullsized":"2024-09-17T04:09:45.488076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488153+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:09:45.488153+0000","last_peered":"2024-09-17T04:09:45.488153+0000","last_clean":"2024-09-17T04:09:45.488153+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:09:45.488153+0000","last_undegraded":"2024-09-17T04:09:45.488153+0000","last_fullsized":"2024-09-17T04:09:45.488153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489688+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:09:45.489688+0000","last_peered":"2024-09-17T04:09:45.489688+0000","last_clean":"2024-09-17T04:09:45.489688+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:09:45.489688+0000","last_undegraded":"2024-09-17T04:09:45.489688+0000","last_fullsized":"2024-09-17T04:09:45.489688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488106+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:09:45.488106+0000","last_peered":"2024-09-17T04:09:45.488106+0000","last_clean":"2024-09-17T04:09:45.488106+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:09:45.488106+0000","last_undegraded":"2024-09-17T04:09:45.488106+0000","last_fullsized":"2024-09-17T04:09:45.488106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381382+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:09:45.381382+0000","last_peered":"2024-09-17T04:09:45.381382+0000","last_clean":"2024-09-17T04:09:45.381382+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:09:45.381382+0000","last_undegraded":"2024-09-17T04:09:45.381382+0000","last_fullsized":"2024-09-17T04:09:45.381382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488352+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:09:45.488352+0000","last_peered":"2024-09-17T04:09:45.488352+0000","last_clean":"2024-09-17T04:09:45.488352+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:09:45.488352+0000","last_undegraded":"2024-09-17T04:09:45.488352+0000","last_fullsized":"2024-09-17T04:09:45.488352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488015+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:09:45.488015+0000","last_peered":"2024-09-17T04:09:45.488015+0000","last_clean":"2024-09-17T04:09:45.488015+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:09:45.488015+0000","last_undegraded":"2024-09-17T04:09:45.488015+0000","last_fullsized":"2024-09-17T04:09:45.488015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.486906+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:09:45.486906+0000","last_peered":"2024-09-17T04:09:45.486906+0000","last_clean":"2024-09-17T04:09:45.486906+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:09:45.486906+0000","last_undegraded":"2024-09-17T04:09:45.486906+0000","last_fullsized":"2024-09-17T04:09:45.486906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487276+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:09:45.487276+0000","last_peered":"2024-09-17T04:09:45.487276+0000","last_clean":"2024-09-17T04:09:45.487276+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:09:45.487276+0000","last_undegraded":"2024-09-17T04:09:45.487276+0000","last_fullsized":"2024-09-17T04:09:45.487276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381357+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:09:45.381357+0000","last_peered":"2024-09-17T04:09:45.381357+0000","last_clean":"2024-09-17T04:09:45.381357+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:09:45.381357+0000","last_undegraded":"2024-09-17T04:09:45.381357+0000","last_fullsized":"2024-09-17T04:09:45.381357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489675+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:09:45.489675+0000","last_peered":"2024-09-17T04:09:45.489675+0000","last_clean":"2024-09-17T04:09:45.489675+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:09:45.489675+0000","last_undegraded":"2024-09-17T04:09:45.489675+0000","last_fullsized":"2024-09-17T04:09:45.489675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488762+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:09:45.488762+0000","last_peered":"2024-09-17T04:09:45.488762+0000","last_clean":"2024-09-17T04:09:45.488762+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:09:45.488762+0000","last_undegraded":"2024-09-17T04:09:45.488762+0000","last_fullsized":"2024-09-17T04:09:45.488762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380081+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:09:45.380081+0000","last_peered":"2024-09-17T04:09:45.380081+0000","last_clean":"2024-09-17T04:09:45.380081+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:09:45.380081+0000","last_undegraded":"2024-09-17T04:09:45.380081+0000","last_fullsized":"2024-09-17T04:09:45.380081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487686+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:09:45.487686+0000","last_peered":"2024-09-17T04:09:45.487686+0000","last_clean":"2024-09-17T04:09:45.487686+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:09:45.487686+0000","last_undegraded":"2024-09-17T04:09:45.487686+0000","last_fullsized":"2024-09-17T04:09:45.487686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376474+0000","last_change":"2024-09-17T04:09:44.390631+0000","last_active":"2024-09-17T04:09:45.376474+0000","last_peered":"2024-09-17T04:09:45.376474+0000","last_clean":"2024-09-17T04:09:45.376474+0000","last_became_active":"2024-09-17T04:09:44.390199+0000","last_became_peered":"2024-09-17T04:09:44.390199+0000","last_unstale":"2024-09-17T04:09:45.376474+0000","last_undegraded":"2024-09-17T04:09:45.376474+0000","last_fullsized":"2024-09-17T04:09:45.376474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:45.662654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487776+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:09:45.487776+0000","last_peered":"2024-09-17T04:09:45.487776+0000","last_clean":"2024-09-17T04:09:45.487776+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:09:45.487776+0000","last_undegraded":"2024-09-17T04:09:45.487776+0000","last_fullsized":"2024-09-17T04:09:45.487776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380623+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:09:45.380623+0000","last_peered":"2024-09-17T04:09:45.380623+0000","last_clean":"2024-09-17T04:09:45.380623+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:09:45.380623+0000","last_undegraded":"2024-09-17T04:09:45.380623+0000","last_fullsized":"2024-09-17T04:09:45.380623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487823+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:09:45.487823+0000","last_peered":"2024-09-17T04:09:45.487823+0000","last_clean":"2024-09-17T04:09:45.487823+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:09:45.487823+0000","last_undegraded":"2024-09-17T04:09:45.487823+0000","last_fullsized":"2024-09-17T04:09:45.487823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.379391+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:09:45.379391+0000","last_peered":"2024-09-17T04:09:45.379391+0000","last_clean":"2024-09-17T04:09:45.379391+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:09:45.379391+0000","last_undegraded":"2024-09-17T04:09:45.379391+0000","last_fullsized":"2024-09-17T04:09:45.379391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376223+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:09:45.376223+0000","last_peered":"2024-09-17T04:09:45.376223+0000","last_clean":"2024-09-17T04:09:45.376223+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:09:45.376223+0000","last_undegraded":"2024-09-17T04:09:45.376223+0000","last_fullsized":"2024-09-17T04:09:45.376223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488269+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:09:45.488269+0000","last_peered":"2024-09-17T04:09:45.488269+0000","last_clean":"2024-09-17T04:09:45.488269+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:09:45.488269+0000","last_undegraded":"2024-09-17T04:09:45.488269+0000","last_fullsized":"2024-09-17T04:09:45.488269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487587+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:09:45.487587+0000","last_peered":"2024-09-17T04:09:45.487587+0000","last_clean":"2024-09-17T04:09:45.487587+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:09:45.487587+0000","last_undegraded":"2024-09-17T04:09:45.487587+0000","last_fullsized":"2024-09-17T04:09:45.487587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489584+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:09:45.489584+0000","last_peered":"2024-09-17T04:09:45.489584+0000","last_clean":"2024-09-17T04:09:45.489584+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:09:45.489584+0000","last_undegraded":"2024-09-17T04:09:45.489584+0000","last_fullsized":"2024-09-17T04:09:45.489584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381271+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:09:45.381271+0000","last_peered":"2024-09-17T04:09:45.381271+0000","last_clean":"2024-09-17T04:09:45.381271+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:09:45.381271+0000","last_undegraded":"2024-09-17T04:09:45.381271+0000","last_fullsized":"2024-09-17T04:09:45.381271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488639+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:09:45.488639+0000","last_peered":"2024-09-17T04:09:45.488639+0000","last_clean":"2024-09-17T04:09:45.488639+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:09:45.488639+0000","last_undegraded":"2024-09-17T04:09:45.488639+0000","last_fullsized":"2024-09-17T04:09:45.488639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487577+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:09:45.487577+0000","last_peered":"2024-09-17T04:09:45.487577+0000","last_clean":"2024-09-17T04:09:45.487577+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:09:45.487577+0000","last_undegraded":"2024-09-17T04:09:45.487577+0000","last_fullsized":"2024-09-17T04:09:45.487577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488654+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:09:45.488654+0000","last_peered":"2024-09-17T04:09:45.488654+0000","last_clean":"2024-09-17T04:09:45.488654+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:09:45.488654+0000","last_undegraded":"2024-09-17T04:09:45.488654+0000","last_fullsized":"2024-09-17T04:09:45.488654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488146+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:09:45.488146+0000","last_peered":"2024-09-17T04:09:45.488146+0000","last_clean":"2024-09-17T04:09:45.488146+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:09:45.488146+0000","last_undegraded":"2024-09-17T04:09:45.488146+0000","last_fullsized":"2024-09-17T04:09:45.488146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487259+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:09:45.487259+0000","last_peered":"2024-09-17T04:09:45.487259+0000","last_clean":"2024-09-17T04:09:45.487259+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:09:45.487259+0000","last_undegraded":"2024-09-17T04:09:45.487259+0000","last_fullsized":"2024-09-17T04:09:45.487259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380298+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:09:45.380298+0000","last_peered":"2024-09-17T04:09:45.380298+0000","last_clean":"2024-09-17T04:09:45.380298+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:09:45.380298+0000","last_undegraded":"2024-09-17T04:09:45.380298+0000","last_fullsized":"2024-09-17T04:09:45.380298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488632+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:09:45.488632+0000","last_peered":"2024-09-17T04:09:45.488632+0000","last_clean":"2024-09-17T04:09:45.488632+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:09:45.488632+0000","last_undegraded":"2024-09-17T04:09:45.488632+0000","last_fullsized":"2024-09-17T04:09:45.488632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.376559+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:09:45.376559+0000","last_peered":"2024-09-17T04:09:45.376559+0000","last_clean":"2024-09-17T04:09:45.376559+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:09:45.376559+0000","last_undegraded":"2024-09-17T04:09:45.376559+0000","last_fullsized":"2024-09-17T04:09:45.376559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488714+0000","last_change":"2024-09-17T04:09:40.357971+0000","last_active":"2024-09-17T04:09:45.488714+0000","last_peered":"2024-09-17T04:09:45.488714+0000","last_clean":"2024-09-17T04:09:45.488714+0000","last_became_active":"2024-09-17T04:09:40.357694+0000","last_became_peered":"2024-09-17T04:09:40.357694+0000","last_unstale":"2024-09-17T04:09:45.488714+0000","last_undegraded":"2024-09-17T04:09:45.488714+0000","last_fullsized":"2024-09-17T04:09:45.488714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487015+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:09:45.487015+0000","last_peered":"2024-09-17T04:09:45.487015+0000","last_clean":"2024-09-17T04:09:45.487015+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:09:45.487015+0000","last_undegraded":"2024-09-17T04:09:45.487015+0000","last_fullsized":"2024-09-17T04:09:45.487015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487021+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:09:45.487021+0000","last_peered":"2024-09-17T04:09:45.487021+0000","last_clean":"2024-09-17T04:09:45.487021+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:09:45.487021+0000","last_undegraded":"2024-09-17T04:09:45.487021+0000","last_fullsized":"2024-09-17T04:09:45.487021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487560+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:09:45.487560+0000","last_peered":"2024-09-17T04:09:45.487560+0000","last_clean":"2024-09-17T04:09:45.487560+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:09:45.487560+0000","last_undegraded":"2024-09-17T04:09:45.487560+0000","last_fullsized":"2024-09-17T04:09:45.487560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381785+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:09:45.381785+0000","last_peered":"2024-09-17T04:09:45.381785+0000","last_clean":"2024-09-17T04:09:45.381785+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:09:45.381785+0000","last_undegraded":"2024-09-17T04:09:45.381785+0000","last_fullsized":"2024-09-17T04:09:45.381785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.380952+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:09:45.380952+0000","last_peered":"2024-09-17T04:09:45.380952+0000","last_clean":"2024-09-17T04:09:45.380952+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:09:45.380952+0000","last_undegraded":"2024-09-17T04:09:45.380952+0000","last_fullsized":"2024-09-17T04:09:45.380952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.381260+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:09:45.381260+0000","last_peered":"2024-09-17T04:09:45.381260+0000","last_clean":"2024-09-17T04:09:45.381260+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:09:45.381260+0000","last_undegraded":"2024-09-17T04:09:45.381260+0000","last_fullsized":"2024-09-17T04:09:45.381260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488192+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:09:45.488192+0000","last_peered":"2024-09-17T04:09:45.488192+0000","last_clean":"2024-09-17T04:09:45.488192+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:09:45.488192+0000","last_undegraded":"2024-09-17T04:09:45.488192+0000","last_fullsized":"2024-09-17T04:09:45.488192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489513+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:09:45.489513+0000","last_peered":"2024-09-17T04:09:45.489513+0000","last_clean":"2024-09-17T04:09:45.489513+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:09:45.489513+0000","last_undegraded":"2024-09-17T04:09:45.489513+0000","last_fullsized":"2024-09-17T04:09:45.489513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487054+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:09:45.487054+0000","last_peered":"2024-09-17T04:09:45.487054+0000","last_clean":"2024-09-17T04:09:45.487054+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:09:45.487054+0000","last_undegraded":"2024-09-17T04:09:45.487054+0000","last_fullsized":"2024-09-17T04:09:45.487054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488027+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:09:45.488027+0000","last_peered":"2024-09-17T04:09:45.488027+0000","last_clean":"2024-09-17T04:09:45.488027+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:09:45.488027+0000","last_undegraded":"2024-09-17T04:09:45.488027+0000","last_fullsized":"2024-09-17T04:09:45.488027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487515+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:09:45.487515+0000","last_peered":"2024-09-17T04:09:45.487515+0000","last_clean":"2024-09-17T04:09:45.487515+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:09:45.487515+0000","last_undegraded":"2024-09-17T04:09:45.487515+0000","last_fullsized":"2024-09-17T04:09:45.487515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488105+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:09:45.488105+0000","last_peered":"2024-09-17T04:09:45.488105+0000","last_clean":"2024-09-17T04:09:45.488105+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:09:45.488105+0000","last_undegraded":"2024-09-17T04:09:45.488105+0000","last_fullsized":"2024-09-17T04:09:45.488105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.487102+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:09:45.487102+0000","last_peered":"2024-09-17T04:09:45.487102+0000","last_clean":"2024-09-17T04:09:45.487102+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:09:45.487102+0000","last_undegraded":"2024-09-17T04:09:45.487102+0000","last_fullsized":"2024-09-17T04:09:45.487102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.489059+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:09:45.489059+0000","last_peered":"2024-09-17T04:09:45.489059+0000","last_clean":"2024-09-17T04:09:45.489059+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:09:45.489059+0000","last_undegraded":"2024-09-17T04:09:45.489059+0000","last_fullsized":"2024-09-17T04:09:45.489059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T04:09:45.488026+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:09:45.488026+0000","last_peered":"2024-09-17T04:09:45.488026+0000","last_clean":"2024-09-17T04:09:45.488026+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:09:45.488026+0000","last_undegraded":"2024-09-17T04:09:45.488026+0000","last_fullsized":"2024-09-17T04:09:45.488026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":880640,"data_stored":702305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":111445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":111481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":111355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":702361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":111515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:09:59.602 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:09:59.602 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T04:09:59.602 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T04:09:59.602 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 -- 172.21.15.104:0/581679988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b5c004d40 msgr2=0x7f6b5c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 --2- 172.21.15.104:0/581679988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b5c004d40 0x7f6b5c005150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b64005fd0 tx=0x7f6b5c005830 comp rx=0 tx=0).stop 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7ad1f640 1 -- 172.21.15.104:0/581679988 reap_dead start 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 -- 172.21.15.104:0/581679988 shutdown_connections 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 -- 172.21.15.104:0/581679988 >> 172.21.15.104:0/581679988 conn(0x7f6b740b6b20 msgr2=0x7f6b740d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 -- 172.21.15.104:0/581679988 shutdown_connections 2024-09-17T04:09:59.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.750+0000 7f6b7c782640 1 -- 172.21.15.104:0/581679988 wait complete. 2024-09-17T04:09:59.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.752+0000 7f6b7c782640 1 Processor -- start 2024-09-17T04:09:59.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.752+0000 7f6b7c782640 1 -- start start 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5c004d40 0x7f6b7414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b740c9a80 0x7f6b741f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740b35e0 con 0x7f6b741f4420 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740b3460 con 0x7f6b5c004d40 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7c782640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740b3760 con 0x7f6b740c9a80 2024-09-17T04:09:59.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49184/0 (socket says 172.21.15.104:49184) 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 -- 172.21.15.104:0/935195894 learned_addr learned my addr 172.21.15.104:0/935195894 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7a51e640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5c004d40 0x7f6b7414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b79d1d640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b740c9a80 0x7f6b741f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 -- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b740c9a80 msgr2=0x7f6b741f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b740c9a80 0x7f6b741f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 -- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5c004d40 msgr2=0x7f6b7414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5c004d40 0x7f6b7414bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 -- 172.21.15.104:0/935195894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b740ca220 con 0x7f6b741f4420 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.753+0000 7f6b7ad1f640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402aea0 tx=0x7f6b64033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.754+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64042070 con 0x7f6b741f4420 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.754+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b64003970 con 0x7f6b741f4420 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.754+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b740ca500 con 0x7f6b741f4420 2024-09-17T04:09:59.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.754+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64038040 con 0x7f6b741f4420 2024-09-17T04:09:59.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.754+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b740caac0 con 0x7f6b741f4420 2024-09-17T04:09:59.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.755+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b74162f00 con 0x7f6b741f4420 2024-09-17T04:09:59.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.755+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b64004030 con 0x7f6b741f4420 2024-09-17T04:09:59.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.756+0000 7f6b72ffd640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 0x7f6b6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:09:59.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.756+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6b640bb350 con 0x7f6b741f4420 2024-09-17T04:09:59.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.756+0000 7f6b7a51e640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 0x7f6b6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:09:59.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.756+0000 7f6b7a51e640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 0x7f6b6007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c001010 tx=0x7f6b6c001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:09:59.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.760+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b64082e00 con 0x7f6b741f4420 2024-09-17T04:09:59.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.975+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b7406a680 con 0x7f6b741f4420 2024-09-17T04:09:59.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.975+0000 7f6b72ffd640 1 -- 172.21.15.104:0/935195894 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6b64087830 con 0x7f6b741f4420 2024-09-17T04:09:59.977 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:09:59.977 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 msgr2=0x7f6b6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 0x7f6b6007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c001010 tx=0x7f6b6c001d60 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 msgr2=0x7f6b741f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402aea0 tx=0x7f6b64033c10 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 shutdown_connections 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f6b60078bc0 0x7f6b6007b0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b741f4420 0x7f6b741f82c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b740c9a80 0x7f6b741f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 --2- 172.21.15.104:0/935195894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5c004d40 0x7f6b7414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 >> 172.21.15.104:0/935195894 conn(0x7f6b740b6b20 msgr2=0x7f6b7415d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:09:59.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 shutdown_connections 2024-09-17T04:09:59.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:09:59.978+0000 7f6b7c782640 1 -- 172.21.15.104:0/935195894 wait complete. 2024-09-17T04:09:59.989 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T04:09:59.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 -- 172.21.15.104:0/2595212692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c0b6250 msgr2=0x7f2b0c0b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2595212692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c0b6660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005fd0 tx=0x7f2b0402aa90 comp rx=0 tx=0).stop 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 -- 172.21.15.104:0/2595212692 shutdown_connections 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2595212692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c0b6660 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2595212692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 0x7f2b0c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 -- 172.21.15.104:0/2595212692 >> 172.21.15.104:0/2595212692 conn(0x7f2b0c0d2350 msgr2=0x7f2b0c0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 -- 172.21.15.104:0/2595212692 shutdown_connections 2024-09-17T04:10:00.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.102+0000 7f2b141ba640 1 -- 172.21.15.104:0/2595212692 wait complete. 2024-09-17T04:10:00.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.104+0000 7f2b141ba640 1 Processor -- start 2024-09-17T04:10:00.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.104+0000 7f2b141ba640 1 -- start start 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c1e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 0x7f2b0c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b6f30 con 0x7f2b0c15cb10 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b6db0 con 0x7f2b0c0b6250 2024-09-17T04:10:00.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b141ba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b70b0 con 0x7f2b0c0d19f0 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49190/0 (socket says 172.21.15.104:49190) 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 -- 172.21.15.104:0/2613993063 learned_addr learned my addr 172.21.15.104:0/2613993063 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b11755640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 0x7f2b0c1f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b11f56640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c1e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 -- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 msgr2=0x7f2b0c1f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 0x7f2b0c1f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 -- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 msgr2=0x7f2b0c1e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c1e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b12757640 1 -- 172.21.15.104:0/2613993063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c1e9680 con 0x7f2b0c15cb10 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.105+0000 7f2b11f56640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c1e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b12757640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009d90 tx=0x7f2b04003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04044070 con 0x7f2b0c15cb10 2024-09-17T04:10:00.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b04004250 con 0x7f2b0c15cb10 2024-09-17T04:10:00.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04004660 con 0x7f2b0c15cb10 2024-09-17T04:10:00.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c1e85e0 con 0x7f2b0c15cb10 2024-09-17T04:10:00.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.106+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c1e8ba0 con 0x7f2b0c15cb10 2024-09-17T04:10:00.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.107+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c0b6660 con 0x7f2b0c15cb10 2024-09-17T04:10:00.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.107+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b04047070 con 0x7f2b0c15cb10 2024-09-17T04:10:00.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.108+0000 7f2b027fc640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 0x7f2af007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.108+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2b040bbf50 con 0x7f2b0c15cb10 2024-09-17T04:10:00.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.108+0000 7f2b11f56640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 0x7f2af007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.108+0000 7f2b11f56640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 0x7f2af007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b08007fd0 tx=0x7f2b08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.112+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b04032030 con 0x7f2b0c15cb10 2024-09-17T04:10:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.320+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b0c153f60 con 0x7f2b0c15cb10 2024-09-17T04:10:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.321+0000 7f2b027fc640 1 -- 172.21.15.104:0/2613993063 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f2b04083a00 con 0x7f2b0c15cb10 2024-09-17T04:10:00.321 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:10:00.321 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:10:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 msgr2=0x7f2af007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 0x7f2af007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b08007fd0 tx=0x7f2b08009040 comp rx=0 tx=0).stop 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 msgr2=0x7f2b0c13e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009d90 tx=0x7f2b04003ce0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 shutdown_connections 2024-09-17T04:10:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f2af0078b90 0x7f2af007b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b0c15cb10 0x7f2b0c13e660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b0c0d19f0 0x7f2b0c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 --2- 172.21.15.104:0/2613993063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b0c0b6250 0x7f2b0c1e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 >> 172.21.15.104:0/2613993063 conn(0x7f2b0c0d2350 msgr2=0x7f2b0c070100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 shutdown_connections 2024-09-17T04:10:00.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.323+0000 7f2b141ba640 1 -- 172.21.15.104:0/2613993063 wait complete. 2024-09-17T04:10:00.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 -- 172.21.15.104:0/3869259457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb090003a50 msgr2=0x7fb090003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/3869259457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb090003a50 0x7fb090003ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009ed0 tx=0x7fb090005830 comp rx=0 tx=0).stop 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 -- 172.21.15.104:0/3869259457 shutdown_connections 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/3869259457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb090003a50 0x7fb090003ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 -- 172.21.15.104:0/3869259457 >> 172.21.15.104:0/3869259457 conn(0x7fb0a40cef40 msgr2=0x7fb0a40cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 -- 172.21.15.104:0/3869259457 shutdown_connections 2024-09-17T04:10:00.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.450+0000 7fb0ab68b640 1 -- 172.21.15.104:0/3869259457 wait complete. 2024-09-17T04:10:00.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.452+0000 7fb0ab68b640 1 Processor -- start 2024-09-17T04:10:00.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.452+0000 7fb0ab68b640 1 -- start start 2024-09-17T04:10:00.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 0x7fb0a41f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0a4070900 0x7fb0a4070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40d1b50 con 0x7fb0a40ca010 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40d19d0 con 0x7fb0a4070900 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0ab68b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a4156fa0 con 0x7fb090003a50 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49198/0 (socket says 172.21.15.104:49198) 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 -- 172.21.15.104:0/277094926 learned_addr learned my addr 172.21.15.104:0/277094926 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a9427640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 0x7fb0a41f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a9c28640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0a4070900 0x7fb0a4070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 -- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 msgr2=0x7fb0a41f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 0x7fb0a41f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 -- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0a4070900 msgr2=0x7fb0a4070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0a4070900 0x7fb0a4070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a8c26640 1 -- 172.21.15.104:0/277094926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4071250 con 0x7fb0a40ca010 2024-09-17T04:10:00.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.453+0000 7fb0a9427640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 0x7fb0a41f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb0a8c26640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb094004db0 tx=0x7fb094001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094001d40 con 0x7fb0a40ca010 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb094016070 con 0x7fb0a40ca010 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094010b40 con 0x7fb0a40ca010 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a40c01f0 con 0x7fb0a40ca010 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.454+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a40c07b0 con 0x7fb0a40ca010 2024-09-17T04:10:00.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.455+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a40ccd10 con 0x7fb0a40ca010 2024-09-17T04:10:00.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.456+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb094010ce0 con 0x7fb0a40ca010 2024-09-17T04:10:00.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.456+0000 7fb099ffb640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 0x7fb08807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.456+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb09409b7b0 con 0x7fb0a40ca010 2024-09-17T04:10:00.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.456+0000 7fb0a9427640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 0x7fb08807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.457+0000 7fb0a9427640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 0x7fb08807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0035000 tx=0x7fb0a0004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.461+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0a4071250 con 0x7fb0a40ca010 2024-09-17T04:10:00.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.672+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0a40b6530 con 0x7fb0a40ca010 2024-09-17T04:10:00.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.673+0000 7fb099ffb640 1 -- 172.21.15.104:0/277094926 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fb0940638b0 con 0x7fb0a40ca010 2024-09-17T04:10:00.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:10:00.673 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 msgr2=0x7fb08807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 0x7fb08807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0035000 tx=0x7fb0a0004a40 comp rx=0 tx=0).stop 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 msgr2=0x7fb0a414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb094004db0 tx=0x7fb094001630 comp rx=0 tx=0).stop 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 shutdown_connections 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb088078b90 0x7fb08807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0a4070900 0x7fb0a4070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0a40ca010 0x7fb0a414d6a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 --2- 172.21.15.104:0/277094926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb090003a50 0x7fb0a41f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 >> 172.21.15.104:0/277094926 conn(0x7fb0a40cef40 msgr2=0x7fb0a40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 shutdown_connections 2024-09-17T04:10:00.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.675+0000 7fb0ab68b640 1 -- 172.21.15.104:0/277094926 wait complete. 2024-09-17T04:10:00.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 -- 172.21.15.104:0/3847762277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c90004800 msgr2=0x7f7c90004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 --2- 172.21.15.104:0/3847762277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c90004800 0x7f7c90004c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c001830 tx=0x7f7c90005830 comp rx=0 tx=0).stop 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 -- 172.21.15.104:0/3847762277 shutdown_connections 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 --2- 172.21.15.104:0/3847762277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c90004800 0x7f7c90004c10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 -- 172.21.15.104:0/3847762277 >> 172.21.15.104:0/3847762277 conn(0x7f7ca80b41d0 msgr2=0x7f7ca80b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 -- 172.21.15.104:0/3847762277 shutdown_connections 2024-09-17T04:10:00.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.798+0000 7f7caef8e640 1 -- 172.21.15.104:0/3847762277 wait complete. 2024-09-17T04:10:00.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.800+0000 7f7caef8e640 1 Processor -- start 2024-09-17T04:10:00.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.800+0000 7f7caef8e640 1 -- start start 2024-09-17T04:10:00.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c90004800 0x7f7ca80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca81e6c70 0x7f7ca815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca80ccac0 con 0x7f7ca815fba0 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca815c9c0 con 0x7f7c90004800 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7caef8e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca80ccc40 con 0x7f7ca81e6c70 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49224/0 (socket says 172.21.15.104:49224) 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 -- 172.21.15.104:0/1617575812 learned_addr learned my addr 172.21.15.104:0/1617575812 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7cacd2a640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c90004800 0x7f7ca80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7cad52b640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca81e6c70 0x7f7ca815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 -- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca81e6c70 msgr2=0x7f7ca815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca81e6c70 0x7f7ca815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 -- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c90004800 msgr2=0x7f7ca80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c90004800 0x7f7ca80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.801+0000 7f7ca7fff640 1 -- 172.21.15.104:0/1617575812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca815cf20 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7ca7fff640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c001950 tx=0x7f7c9c0060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c043070 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c9c003af0 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca815d200 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0064c0 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.802+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca81e6750 con 0x7f7ca815fba0 2024-09-17T04:10:00.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.803+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8152cb0 con 0x7f7ca815fba0 2024-09-17T04:10:00.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.804+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c9c046070 con 0x7f7ca815fba0 2024-09-17T04:10:00.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.804+0000 7f7ca57fa640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 0x7f7c9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:00.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.804+0000 7f7cacd2a640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 0x7f7c9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:00.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.804+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7c9c0bad90 con 0x7f7ca815fba0 2024-09-17T04:10:00.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.805+0000 7f7cacd2a640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 0x7f7c9407b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ca806bb20 tx=0x7f7c98009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:00.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.809+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ca8152cb0 con 0x7f7ca815fba0 2024-09-17T04:10:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.983+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ca80cd1a0 con 0x7f7ca815fba0 2024-09-17T04:10:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.984+0000 7f7ca57fa640 1 -- 172.21.15.104:0/1617575812 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18610 (secure 0 0 0) 0x7f7c9c082900 con 0x7f7ca815fba0 2024-09-17T04:10:00.984 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:10:00.984 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:09:44.731606+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 msgr2=0x7f7c9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 0x7f7c9407b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ca806bb20 tx=0x7f7c98009500 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 msgr2=0x7f7ca813f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c001950 tx=0x7f7c9c0060e0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 shutdown_connections 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f7c94078bc0 0x7f7c9407b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca81e6c70 0x7f7ca815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca815fba0 0x7f7ca813f3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 --2- 172.21.15.104:0/1617575812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c90004800 0x7f7ca80cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:00.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 >> 172.21.15.104:0/1617575812 conn(0x7f7ca80b41d0 msgr2=0x7f7ca80b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:00.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 shutdown_connections 2024-09-17T04:10:00.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:00.987+0000 7f7caef8e640 1 -- 172.21.15.104:0/1617575812 wait complete. 2024-09-17T04:10:00.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:10:01.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 -- 172.21.15.104:0/2450942518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b8162280 msgr2=0x7f14b8162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 --2- 172.21.15.104:0/2450942518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b8162280 0x7f14b8162690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005fd0 tx=0x7f14ac02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 -- 172.21.15.104:0/2450942518 shutdown_connections 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 --2- 172.21.15.104:0/2450942518 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b8162280 0x7f14b8162690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 -- 172.21.15.104:0/2450942518 >> 172.21.15.104:0/2450942518 conn(0x7f14b80b6b20 msgr2=0x7f14b80d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 -- 172.21.15.104:0/2450942518 shutdown_connections 2024-09-17T04:10:01.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.110+0000 7f14bdad3640 1 -- 172.21.15.104:0/2450942518 wait complete. 2024-09-17T04:10:01.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.112+0000 7f14bdad3640 1 Processor -- start 2024-09-17T04:10:01.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.112+0000 7f14bdad3640 1 -- start start 2024-09-17T04:10:01.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b8162280 0x7f14b8156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b8157700 0x7f14b81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f14b815f640 con 0x7f14b80b2e40 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f14b815f4c0 con 0x7f14b8162280 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f14b815f7c0 con 0x7f14b8157700 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49232/0 (socket says 172.21.15.104:49232) 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 -- 172.21.15.104:0/374268632 learned_addr learned my addr 172.21.15.104:0/374268632 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b7fff640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b8157700 0x7f14b81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b6ffd640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b8162280 0x7f14b8156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 -- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b8157700 msgr2=0x7f14b81f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b8157700 0x7f14b81f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 -- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b8162280 msgr2=0x7f14b8156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b8162280 0x7f14b8156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 -- 172.21.15.104:0/374268632 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b8159c20 con 0x7f14b80b2e40 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14b77fe640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14a800c780 tx=0x7f14a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8003b70 con 0x7f14b80b2e40 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14a8003d10 con 0x7f14b80b2e40 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b8158140 con 0x7f14b80b2e40 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.114+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a800aab0 con 0x7f14b80b2e40 2024-09-17T04:10:01.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.115+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b8158920 con 0x7f14b80b2e40 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.115+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b8162f00 con 0x7f14b80b2e40 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.116+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14a800ac50 con 0x7f14b80b2e40 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.117+0000 7f149ffff640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 0x7f14a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.117+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f14a809ad80 con 0x7f14b80b2e40 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.117+0000 7f14b6ffd640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 0x7f14a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.117+0000 7f14b6ffd640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 0x7f14a407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14ac033000 tx=0x7f14ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.121+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14b8162bd0 con 0x7f14b80b2e40 2024-09-17T04:10:01.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.329+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14b81574a0 con 0x7f14b80b2e40 2024-09-17T04:10:01.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.330+0000 7f149ffff640 1 -- 172.21.15.104:0/374268632 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f14a80628c0 con 0x7f14b80b2e40 2024-09-17T04:10:01.330 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:10:01.330 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:10:01.330 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:10:01.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 msgr2=0x7f14a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 0x7f14a407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14ac033000 tx=0x7f14ac004730 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 msgr2=0x7f14b81596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14a800c780 tx=0x7f14a800cc40 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 shutdown_connections 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14a4078bc0 0x7f14a407b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b8162280 0x7f14b8156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14b8157700 0x7f14b81f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 --2- 172.21.15.104:0/374268632 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14b80b2e40 0x7f14b81596e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 >> 172.21.15.104:0/374268632 conn(0x7f14b80b6b20 msgr2=0x7f14b80b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.332+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 shutdown_connections 2024-09-17T04:10:01.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.333+0000 7f14bdad3640 1 -- 172.21.15.104:0/374268632 wait complete. 2024-09-17T04:10:01.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:09:39.684542+0000', 'modified': '2024-09-17T04:09:52.757484+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4425}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4425': {'gid': 4425, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/4000193285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 4000193285}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 4000193285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4425, 'qdb_cluster': [4425]} 2024-09-17T04:10:01.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T04:10:01.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 -- 172.21.15.104:0/3647515445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5670 msgr2=0x7feb3015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 --2- 172.21.15.104:0/3647515445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5670 0x7feb3015f630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feb30073190 tx=0x7feb2802aac0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 -- 172.21.15.104:0/3647515445 shutdown_connections 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 --2- 172.21.15.104:0/3647515445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5670 0x7feb3015f630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 --2- 172.21.15.104:0/3647515445 >> v2:172.21.15.192:3300/0 conn(0x7feb3006def0 0x7feb3006f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 -- 172.21.15.104:0/3647515445 >> 172.21.15.104:0/3647515445 conn(0x7feb300cdca0 msgr2=0x7feb300ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 -- 172.21.15.104:0/3647515445 shutdown_connections 2024-09-17T04:10:01.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.865+0000 7feb3684d640 1 -- 172.21.15.104:0/3647515445 wait complete. 2024-09-17T04:10:01.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.867+0000 7feb3684d640 1 Processor -- start 2024-09-17T04:10:01.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.867+0000 7feb3684d640 1 -- start start 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3006def0 0x7feb3015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb300b5670 0x7feb300b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015ffb0 con 0x7feb300b5260 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015fe30 con 0x7feb3006def0 2024-09-17T04:10:01.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb3684d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb30071300 con 0x7feb300b5670 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb2f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb2f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49248/0 (socket says 172.21.15.104:49248) 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb2f7fe640 1 -- 172.21.15.104:0/3691366462 learned_addr learned my addr 172.21.15.104:0/3691366462 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb2ffff640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3006def0 0x7feb3015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.868+0000 7feb34dea640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb300b5670 0x7feb300b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 -- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb300b5670 msgr2=0x7feb300b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb300b5670 0x7feb300b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 -- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3006def0 msgr2=0x7feb3015e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3006def0 0x7feb3015e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 -- 172.21.15.104:0/3691366462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300b15d0 con 0x7feb300b5260 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c370 tx=0x7feb2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2cff9640 1 -- 172.21.15.104:0/3691366462 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24017070 con 0x7feb300b5260 2024-09-17T04:10:01.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2cff9640 1 -- 172.21.15.104:0/3691366462 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb240053c0 con 0x7feb300b5260 2024-09-17T04:10:01.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb300b18b0 con 0x7feb300b5260 2024-09-17T04:10:01.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb2cff9640 1 -- 172.21.15.104:0/3691366462 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24003850 con 0x7feb300b5260 2024-09-17T04:10:01.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.869+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb300b1e70 con 0x7feb300b5260 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.871+0000 7feb2cff9640 1 -- 172.21.15.104:0/3691366462 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb2401a070 con 0x7feb300b5260 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.871+0000 7feb2cff9640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 0x7feb1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.871+0000 7feb2cff9640 1 -- 172.21.15.104:0/3691366462 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb2409a2d0 con 0x7feb300b5260 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.872+0000 7feb2ffff640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 0x7feb1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.872+0000 7feb3d7ba740 1 Processor -- start 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.872+0000 7feb2ffff640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 0x7feb1c07b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb3015efd0 tx=0x7feb2000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.872+0000 7feb3d7ba740 1 -- start start 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.873+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.873+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c62e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c64b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56443c576820 con 0x56443c25c270 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56443c565c50 con 0x56443c23b590 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x56443c569a60 con 0x56443c2333b0 2024-09-17T04:10:01.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49258/0 (socket says 172.21.15.104:49258) 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 -- 172.21.15.104:0/481527333 learned_addr learned my addr 172.21.15.104:0/481527333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb34dea640 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c64b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c62e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 -- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 msgr2=0x56443c62e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c62e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 -- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 msgr2=0x56443c64b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c64b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 -- 172.21.15.104:0/481527333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443c2c7850 con 0x56443c25c270 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb2ffff640 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feb20010f90 tx=0x7feb20013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6acdb7ec24c3848 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb15ffb640 1 -- 172.21.15.104:0/481527333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20003cf0 con 0x56443c25c270 2024-09-17T04:10:01.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb15ffb640 1 -- 172.21.15.104:0/481527333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20024070 con 0x56443c25c270 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.874+0000 7feb15ffb640 1 -- 172.21.15.104:0/481527333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20011680 con 0x56443c25c270 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 -- 172.21.15.104:0/481527333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 msgr2=0x56443c62dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feb20010f90 tx=0x7feb20013000 comp rx=0 tx=0).stop 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 -- 172.21.15.104:0/481527333 shutdown_connections 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c64b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c62e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/481527333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c62dfa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 -- 172.21.15.104:0/481527333 >> 172.21.15.104:0/481527333 conn(0x56443c2503c0 msgr2=0x56443c604260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 -- 172.21.15.104:0/481527333 shutdown_connections 2024-09-17T04:10:01.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.875+0000 7feb3d7ba740 1 -- 172.21.15.104:0/481527333 wait complete. 2024-09-17T04:10:01.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.876+0000 7feb3d7ba740 1 -- start start 2024-09-17T04:10:01.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.876+0000 7feb3d7ba740 1 Processor -- start 2024-09-17T04:10:01.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c61c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c6425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56443c2d6620 con 0x56443c25c270 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56443c50b5f0 con 0x56443c23b590 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.877+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x56443c62ea20 con 0x56443c2333b0 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb3d7ba740 10 client.0 _ll_register_callbacks cb 0x56443c50f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49268/0 (socket says 172.21.15.104:49268) 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 -- 172.21.15.104:0/40169866 learned_addr learned my addr 172.21.15.104:0/40169866 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c6425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb2ffff640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c61c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 -- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 msgr2=0x56443c61c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c61c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 -- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 msgr2=0x56443c6425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c6425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 -- 172.21.15.104:0/40169866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443c33e6b0 con 0x56443c25c270 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb2ffff640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c61c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb34dea640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb28005fd0 tx=0x7feb2802cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d777755ee99af7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb0effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28003b70 con 0x56443c25c270 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb28003d10 con 0x56443c25c270 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb20024070 con 0x56443c25c270 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feb2804d050 con 0x56443c25c270 2024-09-17T04:10:01.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb3d7ba740 10 client.4845 fetch_fsmap learned FSMap version 9 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56443c6038b0 con 0x56443c25c270 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.878+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20024070 con 0x56443c25c270 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7feb28050020 con 0x56443c25c270 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 10 client.4845 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 10 client.4845 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 20 client.4845 populate_metadata read hostname 'smithi104' 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c21ae40 0x56443c65b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 4 client.4845 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 --> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56443c578770 con 0x56443c21ae40 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb2ffff640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c21ae40 0x56443c65b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb0effd640 10 client.4845 ms_handle_connect on v2:172.21.15.192:6835/4000193285 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.879+0000 7feb2ffff640 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c21ae40 0x56443c65b410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0aedc774d604797 server_cookie=45c08513adc0c048 in_seq=0 out_seq=0 2024-09-17T04:10:01.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb0effd640 1 -- 172.21.15.104:0/40169866 <== mds.0 v2:172.21.15.192:6835/4000193285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56443c578770 con 0x56443c21ae40 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb0effd640 10 client.4845 handle_command_reply: tid=0 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 client.4845 shutdown 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 msgr2=0x56443c640050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb28005fd0 tx=0x7feb2802cab0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 shutdown_connections 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c21ae40 0x56443c65b410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c6425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c25c270 0x56443c640050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb0effd640 0 client.4845 ms_handle_reset on v2:172.21.15.192:6835/4000193285 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/40169866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c2333b0 0x56443c61c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.880+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 >> 172.21.15.104:0/40169866 conn(0x56443c2503c0 msgr2=0x56443c64a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.881+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 shutdown_connections 2024-09-17T04:10:01.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.881+0000 7feb3d7ba740 1 -- 172.21.15.104:0/40169866 wait complete. 2024-09-17T04:10:01.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.881+0000 7feb3d7ba740 20 client.4845 trim_cache size 0 max 16384 2024-09-17T04:10:01.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.898+0000 7feb3d7ba740 1 Processor -- start 2024-09-17T04:10:01.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.899+0000 7feb3d7ba740 1 -- start start 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c65a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c25c270 0x56443c642320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb302003f0 con 0x56443c2333b0 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015b060 con 0x56443c23b590 2024-09-17T04:10:01.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb3006d890 con 0x56443c25c270 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49272/0 (socket says 172.21.15.104:49272) 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 -- 172.21.15.104:0/4215482068 learned_addr learned my addr 172.21.15.104:0/4215482068 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c65a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb34dea640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c25c270 0x56443c642320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 -- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c25c270 msgr2=0x56443c642320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c25c270 0x56443c642320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 -- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 msgr2=0x56443c65a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c65a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 -- 172.21.15.104:0/4215482068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443c642860 con 0x56443c2333b0 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c65a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:10:01.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb2ffff640 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb20020000 tx=0x7feb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fab35a8e42e6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb157fa640 1 -- 172.21.15.104:0/4215482068 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20036430 con 0x56443c2333b0 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.900+0000 7feb157fa640 1 -- 172.21.15.104:0/4215482068 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20024070 con 0x56443c2333b0 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb157fa640 1 -- 172.21.15.104:0/4215482068 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20036870 con 0x56443c2333b0 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 -- 172.21.15.104:0/4215482068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 msgr2=0x56443c6040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feb20020000 tx=0x7feb200046c0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 -- 172.21.15.104:0/4215482068 shutdown_connections 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c23b590 0x56443c65a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c25c270 0x56443c642320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/4215482068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6040f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 -- 172.21.15.104:0/4215482068 >> 172.21.15.104:0/4215482068 conn(0x56443c2503c0 msgr2=0x56443c617ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 -- 172.21.15.104:0/4215482068 shutdown_connections 2024-09-17T04:10:01.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.901+0000 7feb3d7ba740 1 -- 172.21.15.104:0/4215482068 wait complete. 2024-09-17T04:10:01.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.902+0000 7feb3d7ba740 1 -- start start 2024-09-17T04:10:01.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.902+0000 7feb3d7ba740 1 Processor -- start 2024-09-17T04:10:01.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c23b590 0x56443c66c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 0x56443c62d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56443c642c70 con 0x56443c2333b0 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56443c61c610 con 0x56443c25c270 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x56443c62a5e0 con 0x56443c23b590 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 10 client.0 _ll_register_callbacks cb 0x7feb28009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49284/0 (socket says 172.21.15.104:49284) 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 -- 172.21.15.104:0/233731719 learned_addr learned my addr 172.21.15.104:0/233731719 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c23b590 0x56443c66c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb34dea640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 0x56443c62d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 -- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c23b590 msgr2=0x56443c66c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c23b590 0x56443c66c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 -- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 msgr2=0x56443c62d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:10:01.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 0x56443c62d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 -- 172.21.15.104:0/233731719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443c640c10 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb34dea640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 0x56443c62d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb2ffff640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb20010d10 tx=0x7feb20003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576f18c71fcc5ece server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb0effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20036900 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb20036aa0 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb20024070 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feb2004b050 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 10 client.4851 fetch_fsmap learned FSMap version 9 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.904+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56443c61ad50 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20024070 con 0x56443c2333b0 2024-09-17T04:10:01.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7feb2004e020 con 0x56443c2333b0 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 10 client.4851 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 20 client.4851 populate_metadata read hostname 'smithi104' 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c61cb80 0x56443c6025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 4 client.4851 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 --> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] -- command(tid 0: {"prefix": "status"}) -- 0x56443c574220 con 0x56443c61cb80 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c61cb80 0x56443c6025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb0effd640 10 client.4851 ms_handle_connect on v2:172.21.15.192:6835/4000193285 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.905+0000 7feb2f7fe640 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c61cb80 0x56443c6025f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecc5a2db939659b server_cookie=e0ae3c721b4f878e in_seq=0 out_seq=0 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb0effd640 1 -- 172.21.15.104:0/233731719 <== mds.0 v2:172.21.15.192:6835/4000193285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x56443c574220 con 0x56443c61cb80 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb0effd640 10 client.4851 handle_command_reply: tid=0 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 client.4851 shutdown 2024-09-17T04:10:01.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 msgr2=0x56443c6cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb20010d10 tx=0x7feb20003bf0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 shutdown_connections 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:6835/4000193285,v1:172.21.15.192:6837/4000193285] conn(0x56443c61cb80 0x56443c6025f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56443c25c270 0x56443c62d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x56443c23b590 0x56443c66c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb0effd640 0 client.4851 ms_handle_reset on v2:172.21.15.192:6835/4000193285 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 --2- 172.21.15.104:0/233731719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56443c2333b0 0x56443c6cbae0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 >> 172.21.15.104:0/233731719 conn(0x56443c2503c0 msgr2=0x56443c65aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 shutdown_connections 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 1 -- 172.21.15.104:0/233731719 wait complete. 2024-09-17T04:10:01.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.906+0000 7feb3d7ba740 20 client.4851 trim_cache size 0 max 16384 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "6f80e9a4-ab66-4103-911e-380249777ecb", 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4425, 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 21.579479296999999, 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 9, 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 27, 2024-09-17T04:10:01.913 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 27, 2024-09-17T04:10:01.914 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 27.596198063999999 2024-09-17T04:10:01.914 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:10:01.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 msgr2=0x7feb1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 0x7feb1c07b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb3015efd0 tx=0x7feb2000b2e0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 msgr2=0x7feb300b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb2400c370 tx=0x7feb2400c830 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 shutdown_connections 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb1c078bc0 0x7feb1c07b0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb300b5670 0x7feb300b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb300b5260 0x7feb300b2670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 --2- 172.21.15.104:0/3691366462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3006def0 0x7feb3015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 >> 172.21.15.104:0/3691366462 conn(0x7feb300cdca0 msgr2=0x7feb3015cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 shutdown_connections 2024-09-17T04:10:01.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:01.907+0000 7feb3684d640 1 -- 172.21.15.104:0/3691366462 wait complete. 2024-09-17T04:10:01.917 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T04:10:01.932 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T04:10:01.932 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T04:10:01.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:01.932 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:10:01.948 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-17T04:10:01.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:01.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T04:10:02.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T04:10:02.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.114 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:10:02.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.129 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T04:10:02.197 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-09-17T04:10:02.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:10:02.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.198 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:10:02.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.218 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T04:10:02.289 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T04:10:02.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:10:02.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.291 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:10:02.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.350 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T04:10:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T04:10:02.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:10:02.420 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-17T04:10:02.420 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:10:02.420 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:02.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 -- 172.21.15.104:0/1652521380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf1006ddf0 msgr2=0x7fdf1006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 --2- 172.21.15.104:0/1652521380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf1006ddf0 0x7fdf1006e200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdf10076360 tx=0x7fdf0802aa30 comp rx=0 tx=0).stop 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 -- 172.21.15.104:0/1652521380 shutdown_connections 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 --2- 172.21.15.104:0/1652521380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf1006ddf0 0x7fdf1006e200 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 --2- 172.21.15.104:0/1652521380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf100cbc10 0x7fdf100cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 --2- 172.21.15.104:0/1652521380 >> v2:172.21.15.192:3300/0 conn(0x7fdf10074cb0 0x7fdf10073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 -- 172.21.15.104:0/1652521380 >> 172.21.15.104:0/1652521380 conn(0x7fdf100cca40 msgr2=0x7fdf100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 -- 172.21.15.104:0/1652521380 shutdown_connections 2024-09-17T04:10:02.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.534+0000 7fdf15494640 1 -- 172.21.15.104:0/1652521380 wait complete. 2024-09-17T04:10:02.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.536+0000 7fdf15494640 1 Processor -- start 2024-09-17T04:10:02.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.536+0000 7fdf15494640 1 -- start start 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf1006ddf0 0x7fdf101f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100cbc10 0x7fdf10156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1006f170 con 0x7fdf10074cb0 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1006eff0 con 0x7fdf100cbc10 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf15494640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1006f2f0 con 0x7fdf1006ddf0 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49300/0 (socket says 172.21.15.104:49300) 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 -- 172.21.15.104:0/553772239 learned_addr learned my addr 172.21.15.104:0/553772239 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:02.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf0effd640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf1006ddf0 0x7fdf101f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf0f7fe640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100cbc10 0x7fdf10156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 -- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf1006ddf0 msgr2=0x7fdf101f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf1006ddf0 0x7fdf101f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 -- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100cbc10 msgr2=0x7fdf10156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100cbc10 0x7fdf10156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 -- 172.21.15.104:0/553772239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf10158070 con 0x7fdf10074cb0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf067fc640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c970 tx=0x7fdef800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.538+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8007bb0 con 0x7fdf10074cb0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.539+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef8005020 con 0x7fdf10074cb0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.539+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf101541a0 con 0x7fdf10074cb0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.539+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8007e60 con 0x7fdf10074cb0 2024-09-17T04:10:02.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.539+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf101f38a0 con 0x7fdf10074cb0 2024-09-17T04:10:02.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.540+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf10158690 con 0x7fdf10074cb0 2024-09-17T04:10:02.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.540+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdef8005470 con 0x7fdf10074cb0 2024-09-17T04:10:02.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.541+0000 7fdf07fff640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 0x7fdef007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:02.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.541+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdef809b480 con 0x7fdf10074cb0 2024-09-17T04:10:02.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.541+0000 7fdf0effd640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 0x7fdef007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:02.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.541+0000 7fdf0effd640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 0x7fdef007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf00005fd0 tx=0x7fdf0000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:02.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.545+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdef8014030 con 0x7fdf10074cb0 2024-09-17T04:10:02.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.753+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdf10073dd0 con 0x7fdf10074cb0 2024-09-17T04:10:02.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.754+0000 7fdf07fff640 1 -- 172.21.15.104:0/553772239 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fdef8062fc0 con 0x7fdf10074cb0 2024-09-17T04:10:02.754 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 msgr2=0x7fdef007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 0x7fdef007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf00005fd0 tx=0x7fdf0000a250 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 msgr2=0x7fdf100b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c970 tx=0x7fdef800ce30 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 shutdown_connections 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fdef0078b90 0x7fdef007b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100cbc10 0x7fdf10156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf10074cb0 0x7fdf100b0b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 --2- 172.21.15.104:0/553772239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf1006ddf0 0x7fdf101f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 >> 172.21.15.104:0/553772239 conn(0x7fdf100cca40 msgr2=0x7fdf100caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:02.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 shutdown_connections 2024-09-17T04:10:02.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02.756+0000 7fdf15494640 1 -- 172.21.15.104:0/553772239 wait complete. 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:02.767 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:10:02.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:10:02.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:10:02.768 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:10:02.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.768 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:02.784 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42779sec preferred_lft 42779sec 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T04:10:02.785 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:02.786 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:10:02.786 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:02.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:02.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.922 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:10:02.945 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T04:10:02.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:02.947 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T04:10:03.002 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T04:10:03.002 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:10:03.002 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:10:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:10:03.003 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:10:03.003 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:03.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:03.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:03.128 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:10:03.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:03.143 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-09-17T04:10:03.199 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:03.199 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:03.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:10:03.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T04:10:03.199 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:03.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:03.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:03.315 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T04:10:03.315 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:03.315 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:03.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T04:10:03.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:10:03.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T04:10:03.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T04:10:03.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T04:10:03.316 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:03.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:03.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:03.428 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:03.428 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:03.428 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T04:10:03.428 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:10:03.428 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:03.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:03.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:03.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:03.506 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:03.521 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:10:03.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:03.521 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:03.576 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T04:10:03.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:03.577 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:03.670 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:03.671 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:03.797 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:03.797 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:03.797 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T04:10:03.797 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with new device syntax: 0@6f80e9a4-ab66-4103-911e-380249777ecb.cephfs=/ 2024-09-17T04:10:03.797 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.104:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2024-09-17T04:10:03.798 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T04:10:03.798 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:10:03.798 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:10:03.798 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:10:03.798 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:10:03.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:10:03.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:03.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:03.824 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:03.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:03.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:03.921 INFO:teuthology.orchestra.run.smithi104.stdout:client4613 2024-09-17T04:10:03.921 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:10:03.921 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:10:03.937 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:04.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:04.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:04.033 INFO:teuthology.orchestra.run.smithi104.stdout:client4613 2024-09-17T04:10:04.033 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:04.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:04.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:04.088 INFO:teuthology.orchestra.run.smithi104.stdout:client4613 2024-09-17T04:10:04.088 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f80e9a4-ab66-4103-911e-380249777ecb.client4613/status') 2024-09-17T04:10:04.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4613 (3)172.21.15.104:0/2037847897 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stderr:71 bytes copied, 3.7958e-05 s, 1.9 MB/s 2024-09-17T04:10:04.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:04.153 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-17T04:10:04.153 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:10:04.154 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T04:10:04.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 -- 172.21.15.104:0/2693398640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff400ca610 msgr2=0x7eff400cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 --2- 172.21.15.104:0/2693398640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff400ca610 0x7eff400cdb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff30009830 tx=0x7eff3002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 -- 172.21.15.104:0/2693398640 shutdown_connections 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 --2- 172.21.15.104:0/2693398640 >> v2:172.21.15.192:3300/0 conn(0x7eff400ce0d0 0x7eff40073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 --2- 172.21.15.104:0/2693398640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff400ca610 0x7eff400cdb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 -- 172.21.15.104:0/2693398640 >> 172.21.15.104:0/2693398640 conn(0x7eff400cca40 msgr2=0x7eff400cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 -- 172.21.15.104:0/2693398640 shutdown_connections 2024-09-17T04:10:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.266+0000 7eff46ef2640 1 -- 172.21.15.104:0/2693398640 wait complete. 2024-09-17T04:10:04.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.268+0000 7eff46ef2640 1 Processor -- start 2024-09-17T04:10:04.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.268+0000 7eff46ef2640 1 -- start start 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff40074360 0x7eff400b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff400ca610 0x7eff400a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7eff4015bcb0 con 0x7eff400ce0d0 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff4015bb30 con 0x7eff400ca610 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff46ef2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7eff4015be30 con 0x7eff40074360 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff4548f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:04.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff4548f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49308/0 (socket says 172.21.15.104:49308) 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff4548f640 1 -- 172.21.15.104:0/4101797588 learned_addr learned my addr 172.21.15.104:0/4101797588 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff44c8e640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff40074360 0x7eff400b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.269+0000 7eff3ffff640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff400ca610 0x7eff400a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 -- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff40074360 msgr2=0x7eff400b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff40074360 0x7eff400b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 -- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff400ca610 msgr2=0x7eff400a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff400ca610 0x7eff400a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 -- 172.21.15.104:0/4101797588 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4009ab60 con 0x7eff400ce0d0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff4548f640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff3800cb10 tx=0x7eff3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38016020 con 0x7eff400ce0d0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff3800ad60 con 0x7eff400ce0d0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4009ae40 con 0x7eff400ce0d0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38012680 con 0x7eff400ce0d0 2024-09-17T04:10:04.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.270+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff400b0230 con 0x7eff400ce0d0 2024-09-17T04:10:04.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.271+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4009b080 con 0x7eff400ce0d0 2024-09-17T04:10:04.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.272+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff38019020 con 0x7eff400ce0d0 2024-09-17T04:10:04.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.272+0000 7eff3d7fa640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:04.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.272+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7eff3809b3d0 con 0x7eff400ce0d0 2024-09-17T04:10:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.273+0000 7eff44c8e640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.273+0000 7eff44c8e640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 0x7eff2c07b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff30034000 tx=0x7eff30004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.277+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff4009b080 con 0x7eff400ce0d0 2024-09-17T04:10:04.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.491+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7eff4006a680 con 0x7eff400ce0d0 2024-09-17T04:10:04.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.491+0000 7eff3d7fa640 1 -- 172.21.15.104:0/4101797588 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7eff4006a680 con 0x7eff400ce0d0 2024-09-17T04:10:04.491 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.493+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 msgr2=0x7eff2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.493+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 0x7eff2c07b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff30034000 tx=0x7eff30004730 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 msgr2=0x7eff400a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff3800cb10 tx=0x7eff3800a060 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 shutdown_connections 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff400ca610 0x7eff400a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff400ce0d0 0x7eff400a0a90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 --2- 172.21.15.104:0/4101797588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff40074360 0x7eff400b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 >> 172.21.15.104:0/4101797588 conn(0x7eff400cca40 msgr2=0x7eff4015dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:04.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 shutdown_connections 2024-09-17T04:10:04.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04.494+0000 7eff46ef2640 1 -- 172.21.15.104:0/4101797588 wait complete. 2024-09-17T04:10:04.504 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:10:04.505 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T04:10:04.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.505 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T04:10:04.521 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42778sec preferred_lft 42778sec 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0a:58:ef:e6:85:d4 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T04:10:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::94bb:99ff:fef6:d3b7/64 scope link 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0a:58:ef:e6:85:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::858:efff:fee6:85d4/64 scope link tentative 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:04.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.523 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:10:04.584 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T04:10:04.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.586 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T04:10:04.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:10:04.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:10:04.642 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T04:10:04.642 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:10:04.642 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:10:04.642 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:10:04.643 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:10:04.643 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:04.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:04.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:04.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.803 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:10:04.818 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:10:04.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.819 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-09-17T04:10:04.874 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T04:10:04.875 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:04.875 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:04.875 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T04:10:04.875 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T04:10:04.875 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:04.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:04.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:04.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:04.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T04:10:05.017 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:05.017 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:05.017 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:05.018 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.018 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:05.018 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.018 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:05.018 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether f6:bb:0a:7f:67:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:10:05.019 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:10:05.019 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.019 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::f4bb:aff:fe7f:67b5/64 scope link tentative 2024-09-17T04:10:05.019 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:05.021 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T04:10:05.085 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:05.085 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:05.086 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:05.086 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.086 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:05.086 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.086 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:05.087 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether f6:bb:0a:7f:67:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:10:05.087 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:10:05.087 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.087 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::f4bb:aff:fe7f:67b5/64 scope link tentative 2024-09-17T04:10:05.087 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:05.089 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T04:10:05.089 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:05.093 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:05.093 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T04:10:05.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T04:10:05.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T04:10:05.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T04:10:05.094 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T04:10:05.094 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:05.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:05.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.240 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:05.240 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T04:10:05.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2024-09-17T04:10:05.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T04:10:05.240 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T04:10:05.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:05.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:05.317 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T04:10:05.344 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T04:10:05.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:05.344 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T04:10:05.400 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-17T04:10:05.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:05.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:05.495 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:05.495 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with new device syntax: 2@6f80e9a4-ab66-4103-911e-380249777ecb.cephfs=/ 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.104:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2024-09-17T04:10:05.504 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T04:10:05.505 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:10:05.505 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:10:05.505 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:10:05.505 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:10:05.506 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:10:05.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:05.507 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T04:10:05.536 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:05.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:05.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.632 INFO:teuthology.orchestra.run.smithi104.stdout:client4866 2024-09-17T04:10:05.632 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:10:05.632 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:10:05.649 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:05.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:05.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.744 INFO:teuthology.orchestra.run.smithi104.stdout:client4866 2024-09-17T04:10:05.744 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:05.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:05.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.800 INFO:teuthology.orchestra.run.smithi104.stdout:client4866 2024-09-17T04:10:05.800 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f80e9a4-ab66-4103-911e-380249777ecb.client4866/status') 2024-09-17T04:10:05.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:05.858 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4866 (3)192.168.0.2:0/497523882 2024-09-17T04:10:05.858 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-09-17T04:10:05.858 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-09-17T04:10:05.858 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-09-17T04:10:05.858 INFO:teuthology.orchestra.run.smithi104.stderr:68 bytes copied, 2.1515e-05 s, 3.2 MB/s 2024-09-17T04:10:05.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:05.865 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-17T04:10:05.865 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:10:05.865 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:10:05.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:10:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 -- 172.21.15.104:0/2093972080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd254004800 msgr2=0x7fd254004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 --2- 172.21.15.104:0/2093972080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd254004800 0x7fd254004c10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd258006f80 tx=0x7fd254005830 comp rx=0 tx=0).stop 2024-09-17T04:10:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 -- 172.21.15.104:0/2093972080 shutdown_connections 2024-09-17T04:10:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 --2- 172.21.15.104:0/2093972080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd254004800 0x7fd254004c10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 -- 172.21.15.104:0/2093972080 >> 172.21.15.104:0/2093972080 conn(0x7fd2680d0a30 msgr2=0x7fd2680d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 -- 172.21.15.104:0/2093972080 shutdown_connections 2024-09-17T04:10:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.979+0000 7fd270007640 1 -- 172.21.15.104:0/2093972080 wait complete. 2024-09-17T04:10:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.981+0000 7fd270007640 1 Processor -- start 2024-09-17T04:10:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.981+0000 7fd270007640 1 -- start start 2024-09-17T04:10:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 0x7fd26815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd26806ce70 0x7fd26806d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd2680b4ad0 con 0x7fd26815b520 2024-09-17T04:10:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2680b4950 con 0x7fd26806ce70 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd270007640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd2680b4c50 con 0x7fd254004800 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd26d5a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd26d5a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49328/0 (socket says 172.21.15.104:49328) 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd26d5a2640 1 -- 172.21.15.104:0/3526537435 learned_addr learned my addr 172.21.15.104:0/3526537435 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd26dda3640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 0x7fd26815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.982+0000 7fd26e5a4640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd26806ce70 0x7fd26806d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 -- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 msgr2=0x7fd26815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 0x7fd26815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 -- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd26806ce70 msgr2=0x7fd26806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd26806ce70 0x7fd26806d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 -- 172.21.15.104:0/3526537435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26806d7c0 con 0x7fd26815b520 2024-09-17T04:10:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26dda3640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 0x7fd26815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd26d5a2640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd25800c350 tx=0x7fd2580011d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd258032030 con 0x7fd26815b520 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2580038e0 con 0x7fd26815b520 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd258003cf0 con 0x7fd26815b520 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2681f66c0 con 0x7fd26815b520 2024-09-17T04:10:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.983+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd268144760 con 0x7fd26815b520 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.984+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26806f5f0 con 0x7fd26815b520 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.985+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd258035020 con 0x7fd26815b520 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.985+0000 7fd25e7fc640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 0x7fd24c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.985+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd2580ba620 con 0x7fd26815b520 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.985+0000 7fd26dda3640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 0x7fd24c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.986+0000 7fd26dda3640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 0x7fd24c07b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd268052860 tx=0x7fd264006b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:05.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:05.990+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd26806d7c0 con 0x7fd26815b520 2024-09-17T04:10:06.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.201+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd2680cf180 con 0x7fd26815b520 2024-09-17T04:10:06.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.201+0000 7fd25e7fc640 1 -- 172.21.15.104:0/3526537435 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd258082720 con 0x7fd26815b520 2024-09-17T04:10:06.201 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T04:10:06.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 msgr2=0x7fd24c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 0x7fd24c07b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd268052860 tx=0x7fd264006b20 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 msgr2=0x7fd2681f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd25800c350 tx=0x7fd2580011d0 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 shutdown_connections 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd24c078bc0 0x7fd24c07b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd26806ce70 0x7fd26806d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd26815b520 0x7fd2681f2900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 --2- 172.21.15.104:0/3526537435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd254004800 0x7fd26815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 >> 172.21.15.104:0/3526537435 conn(0x7fd2680d0a30 msgr2=0x7fd2680cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 shutdown_connections 2024-09-17T04:10:06.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:06.203+0000 7fd270007640 1 -- 172.21.15.104:0/3526537435 wait complete. 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:10:06.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:10:06.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:06.215 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T04:10:06.235 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42750sec preferred_lft 42750sec 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T04:10:06.236 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:06.236 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:10:06.237 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:06.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:06.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:06.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:06.481 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:10:06.506 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T04:10:06.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:06.508 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T04:10:06.575 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T04:10:06.576 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:10:06.576 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:10:06.576 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:10:06.576 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:10:06.576 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:06.576 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:06.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:10:06.577 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:10:06.577 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:10:06.577 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:06.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:06.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:06.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:06.870 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:10:06.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:06.886 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-17T04:10:06.941 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:06.942 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:06.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:10:06.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T04:10:06.942 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:07.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:07.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.064 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T04:10:07.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T04:10:07.065 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T04:10:07.065 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:07.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:07.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.198 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:07.198 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:07.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T04:10:07.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:10:07.198 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:07.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:07.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:07.286 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T04:10:07.300 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:10:07.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:07.300 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:10:07.356 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T04:10:07.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:07.356 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:07.460 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:07.460 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:07.605 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:07.605 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:07.605 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@6f80e9a4-ab66-4103-911e-380249777ecb.cephfs=/ 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.104:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:10:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:10:07.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:10:07.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:07.608 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:10:07.633 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:07.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:07.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:client4625 2024-09-17T04:10:07.728 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:10:07.728 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:10:07.744 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:07.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:07.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.839 INFO:teuthology.orchestra.run.smithi192.stdout:client4625 2024-09-17T04:10:07.839 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:07.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:07.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.895 INFO:teuthology.orchestra.run.smithi192.stdout:client4625 2024-09-17T04:10:07.896 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f80e9a4-ab66-4103-911e-380249777ecb.client4625/status') 2024-09-17T04:10:07.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:07.961 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4625 (3)192.168.0.1:0/1655815418 2024-09-17T04:10:07.962 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-17T04:10:07.962 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-17T04:10:07.962 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-17T04:10:07.962 INFO:teuthology.orchestra.run.smithi192.stderr:69 bytes copied, 2.1981e-05 s, 3.1 MB/s 2024-09-17T04:10:07.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:07.969 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-17T04:10:07.969 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:10:07.969 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T04:10:07.969 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:10:08.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 -- 172.21.15.104:0/3699924302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 msgr2=0x7fbf5c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/3699924302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf5c003e30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf640017c0 tx=0x7fbf5c005830 comp rx=0 tx=0).stop 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 -- 172.21.15.104:0/3699924302 shutdown_connections 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/3699924302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf5c003e30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 -- 172.21.15.104:0/3699924302 >> 172.21.15.104:0/3699924302 conn(0x7fbf740b6b20 msgr2=0x7fbf740d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 -- 172.21.15.104:0/3699924302 shutdown_connections 2024-09-17T04:10:08.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.097+0000 7fbf78e9b640 1 -- 172.21.15.104:0/3699924302 wait complete. 2024-09-17T04:10:08.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.099+0000 7fbf78e9b640 1 Processor -- start 2024-09-17T04:10:08.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.099+0000 7fbf78e9b640 1 -- start start 2024-09-17T04:10:08.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:08.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf741e7ff0 0x7fbf7406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf741e9c70 0x7fbf7406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740d24d0 con 0x7fbf5c003a00 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7415fb30 con 0x7fbf741e7ff0 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf740d2650 con 0x7fbf741e9c70 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52904/0 (socket says 172.21.15.104:52904) 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 -- 172.21.15.104:0/2143800463 learned_addr learned my addr 172.21.15.104:0/2143800463 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf72d9d640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf741e9c70 0x7fbf7406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf71d9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf741e7ff0 0x7fbf7406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:08.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 -- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf741e9c70 msgr2=0x7fbf7406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf741e9c70 0x7fbf7406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 -- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf741e7ff0 msgr2=0x7fbf7406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf741e7ff0 0x7fbf7406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 -- 172.21.15.104:0/2143800463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf74157590 con 0x7fbf5c003a00 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf7259c640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf640018e0 tx=0x7fbf64006130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64040020 con 0x7fbf5c003a00 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf64004840 con 0x7fbf5c003a00 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf74157830 con 0x7fbf5c003a00 2024-09-17T04:10:08.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64037040 con 0x7fbf5c003a00 2024-09-17T04:10:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.101+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741617f0 con 0x7fbf5c003a00 2024-09-17T04:10:08.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.102+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74162690 con 0x7fbf5c003a00 2024-09-17T04:10:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.103+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf64043020 con 0x7fbf5c003a00 2024-09-17T04:10:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.104+0000 7fbf62ffd640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 0x7fbf5407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:10:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.104+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbf640bb3d0 con 0x7fbf5c003a00 2024-09-17T04:10:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.104+0000 7fbf71d9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 0x7fbf5407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:10:08.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.104+0000 7fbf71d9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 0x7fbf5407b100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000fd0 tx=0x7fbf68001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:10:08.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.108+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf64006240 con 0x7fbf5c003a00 2024-09-17T04:10:08.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.316+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf7406d1f0 con 0x7fbf5c003a00 2024-09-17T04:10:08.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.316+0000 7fbf62ffd640 1 -- 172.21.15.104:0/2143800463 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fbf64083450 con 0x7fbf5c003a00 2024-09-17T04:10:08.316 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T04:10:08.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 msgr2=0x7fbf5407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 0x7fbf5407b100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000fd0 tx=0x7fbf68001ad0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 msgr2=0x7fbf741e8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf640018e0 tx=0x7fbf64006130 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 shutdown_connections 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbf54078bf0 0x7fbf5407b100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf741e7ff0 0x7fbf7406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf741e9c70 0x7fbf7406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 --2- 172.21.15.104:0/2143800463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf5c003a00 0x7fbf741e8ec0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.318+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 >> 172.21.15.104:0/2143800463 conn(0x7fbf740b6b20 msgr2=0x7fbf7415ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.319+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 shutdown_connections 2024-09-17T04:10:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:10:08.319+0000 7fbf78e9b640 1 -- 172.21.15.104:0/2143800463 wait complete. 2024-09-17T04:10:08.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:10:08.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T04:10:08.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.330 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T04:10:08.347 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 5e:3e:a3:42:2a:ee brd ff:ff:ff:ff:ff:ff 2024-09-17T04:10:08.348 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::c032:2dff:fea7:7d55/64 scope link 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 5e:3e:a3:42:2a:ee brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::5c3e:a3ff:fe42:2aee/64 scope link tentative 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.349 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:10:08.411 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T04:10:08.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.413 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T04:10:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T04:10:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:10:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:10:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:10:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:10:08.470 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:08.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.597 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:10:08.613 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T04:10:08.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.613 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-17T04:10:08.668 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T04:10:08.668 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:08.668 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:08.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T04:10:08.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T04:10:08.668 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:08.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.784 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:09:5e:44:ac:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:10:08.808 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:10:08.809 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.809 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::3009:5eff:fe44:ac1e/64 scope link tentative 2024-09-17T04:10:08.809 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:08.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:09:5e:44:ac:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:10:08.874 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.875 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::3009:5eff:fe44:ac1e/64 scope link tentative 2024-09-17T04:10:08.875 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:10:08.875 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T04:10:08.876 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:09.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.027 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:10:09.027 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T04:10:09.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2024-09-17T04:10:09.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T04:10:09.027 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T04:10:09.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:09.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:09.103 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T04:10:09.118 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T04:10:09.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:10:09.118 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T04:10:09.173 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-17T04:10:09.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:09.174 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:09.267 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:09.267 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T04:10:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T04:10:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T04:10:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 3@6f80e9a4-ab66-4103-911e-380249777ecb.cephfs=/ 2024-09-17T04:10:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.104:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2024-09-17T04:10:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T04:10:09.277 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:10:09.277 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:10:09.277 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:10:09.277 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:10:09.279 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:10:09.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:10:09.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T04:10:09.303 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.401 INFO:teuthology.orchestra.run.smithi192.stdout:client4881 2024-09-17T04:10:09.401 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:10:09.401 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:10:09.417 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:09.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:09.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.513 INFO:teuthology.orchestra.run.smithi192.stdout:client4881 2024-09-17T04:10:09.513 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:10:09.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:10:09.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.568 INFO:teuthology.orchestra.run.smithi192.stdout:client4881 2024-09-17T04:10:09.568 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f80e9a4-ab66-4103-911e-380249777ecb.client4881/status') 2024-09-17T04:10:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:10:09.626 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4881 (3)172.21.15.192:0/2825113589 2024-09-17T04:10:09.626 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-17T04:10:09.626 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-17T04:10:09.626 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-17T04:10:09.626 INFO:teuthology.orchestra.run.smithi192.stderr:71 bytes copied, 3.9548e-05 s, 1.8 MB/s 2024-09-17T04:10:09.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T04:10:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:10:09.633 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T04:10:09.649 INFO:tasks.workunit:Pulling workunits from ref ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:10:09.649 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T04:10:09.650 DEBUG:teuthology.orchestra.run.smithi104:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T04:10:09.669 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 04:09:40.328343600 +0000 2024-09-17T04:10:09.670 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 04:09:49.907018861 +0000 2024-09-17T04:10:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 04:09:40.328343600 +0000 2024-09-17T04:10:09.670 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T04:10:09.670 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T04:10:09.742 INFO:tasks.workunit:timeout=3h 2024-09-17T04:10:09.743 INFO:tasks.workunit:cleanup=True 2024-09-17T04:10:09.743 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:10:09.801 INFO:tasks.workunit.client.0.smithi104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T04:10:34.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:10:34.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:11:04.958 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:11:04.962 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:11:09.331 INFO:tasks.workunit.client.0.smithi104.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: git switch -c 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr:Or undo this operation with: 2024-09-17T04:11:09.332 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.333 INFO:tasks.workunit.client.0.smithi104.stderr: git switch - 2024-09-17T04:11:09.333 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.333 INFO:tasks.workunit.client.0.smithi104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T04:11:09.333 INFO:tasks.workunit.client.0.smithi104.stderr: 2024-09-17T04:11:09.333 INFO:tasks.workunit.client.0.smithi104.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:11:09.336 DEBUG:teuthology.orchestra.run.smithi104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T04:11:09.467 INFO:tasks.workunit.client.0.smithi104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T04:11:09.470 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:11:09.470 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T04:11:10.025 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T04:11:10.092 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T04:11:10.130 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T04:11:10.132 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:11:10.132 INFO:tasks.workunit.client.0.smithi104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T04:11:10.170 INFO:tasks.workunit.client.0.smithi104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T04:11:10.173 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:11:10.173 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T04:11:10.188 INFO:tasks.workunit:Running workunits matching fs/maxentries on client.0... 2024-09-17T04:11:10.190 INFO:tasks.workunit:Running workunit fs/maxentries/maxentries.sh... 2024-09-17T04:11:10.190 DEBUG:teuthology.orchestra.run.smithi104:workunit test fs/maxentries/maxentries.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/maxentries/maxentries.sh 2024-09-17T04:11:10.252 INFO:tasks.workunit.client.0.smithi104.stderr:+ test_dir=max_entries 2024-09-17T04:11:10.253 INFO:tasks.workunit.client.0.smithi104.stderr:+ mkdir -p max_entries 2024-09-17T04:11:10.253 INFO:tasks.workunit.client.0.smithi104.stderr:+ pushd max_entries 2024-09-17T04:11:10.253 INFO:tasks.workunit.client.0.smithi104.stdout:~/cephtest/mnt.0/client.0/tmp/max_entries ~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:11:10.254 INFO:tasks.workunit.client.0.smithi104.stderr:+ dir_max_entries=100 2024-09-17T04:11:10.254 INFO:tasks.workunit.client.0.smithi104.stderr:+ ceph config set mds mds_dir_max_entries 100 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 -- 172.21.15.104:0/1563376857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c015ee00 msgr2=0x7fa0c00caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 --2- 172.21.15.104:0/1563376857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c015ee00 0x7fa0c00caff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00c4470 tx=0x7fa0b002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 -- 172.21.15.104:0/1563376857 shutdown_connections 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 --2- 172.21.15.104:0/1563376857 >> v2:172.21.15.192:3300/0 conn(0x7fa0c006ed90 0x7fa0c015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 --2- 172.21.15.104:0/1563376857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c015ee00 0x7fa0c00caff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 -- 172.21.15.104:0/1563376857 >> 172.21.15.104:0/1563376857 conn(0x7fa0c00cdad0 msgr2=0x7fa0c0073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:10.347 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 -- 172.21.15.104:0/1563376857 shutdown_connections 2024-09-17T04:11:10.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.347+0000 7fa0c693a640 1 -- 172.21.15.104:0/1563376857 wait complete. 2024-09-17T04:11:10.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.349+0000 7fa0c693a640 1 Processor -- start 2024-09-17T04:11:10.348 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.349+0000 7fa0c693a640 1 -- start start 2024-09-17T04:11:10.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c006f660 0x7fa0c014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:10.351 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c015ee00 0x7fa0c00ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c006fbf0 con 0x7fa0c00b6d50 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c006fa70 con 0x7fa0c006f660 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c693a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c006fd70 con 0x7fa0c015ee00 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c4ed7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c4ed7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33722/0 (socket says 172.21.15.104:33722) 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0c4ed7640 1 -- 172.21.15.104:0/155639856 learned_addr learned my addr 172.21.15.104:0/155639856 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0bffff640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c006f660 0x7fa0c014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.350+0000 7fa0bf7fe640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c015ee00 0x7fa0c00ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 -- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c015ee00 msgr2=0x7fa0c00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c015ee00 0x7fa0c00ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.352 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 -- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c006f660 msgr2=0x7fa0c014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c006f660 0x7fa0c014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c00aeca0 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c4ed7640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d9d0 tx=0x7fa0b800de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8017070 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0b8003970 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c00aef80 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800be60 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.351+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c014f2d0 con 0x7fa0c00b6d50 2024-09-17T04:11:10.353 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.352+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c015f6a0 con 0x7fa0c00b6d50 2024-09-17T04:11:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.353+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0b8010460 con 0x7fa0c00b6d50 2024-09-17T04:11:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.353+0000 7fa0bcff9640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.353+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa0b809b330 con 0x7fa0c00b6d50 2024-09-17T04:11:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.354+0000 7fa0bffff640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:10.354 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.354+0000 7fa0bffff640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:10.357 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.358+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0b8062e40 con 0x7fa0c00b6d50 2024-09-17T04:11:10.534 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.535+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) -- 0x7fa0c01f9870 con 0x7fa0c00b6d50 2024-09-17T04:11:10.538 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.538+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v32)=0 v32) ==== 119+0+0 (secure 0 0 0) 0x7fa0b8067870 con 0x7fa0c00b6d50 2024-09-17T04:11:10.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.642+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) -- 0x7fa0c00b0790 con 0x7fa0c00b6d50 2024-09-17T04:11:10.642 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.643+0000 7fa0bcff9640 1 -- 172.21.15.104:0/155639856 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v32)=0 v32) ==== 119+0+0 (secure 0 0 0) 0x7fa0b806c720 con 0x7fa0c00b6d50 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 msgr2=0x7fa0ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0034000 tx=0x7fa0b0004730 comp rx=0 tx=0).stop 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 msgr2=0x7fa0c00ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d9d0 tx=0x7fa0b800de90 comp rx=0 tx=0).stop 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 shutdown_connections 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa0ac078b90 0x7fa0ac07b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0c00b6d50 0x7fa0c00ceab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.645 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0c015ee00 0x7fa0c00ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 --2- 172.21.15.104:0/155639856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c006f660 0x7fa0c014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:10.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 >> 172.21.15.104:0/155639856 conn(0x7fa0c00cdad0 msgr2=0x7fa0c00cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:10.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 shutdown_connections 2024-09-17T04:11:10.646 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:10.645+0000 7fa0c693a640 1 -- 172.21.15.104:0/155639856 wait complete. 2024-09-17T04:11:10.653 INFO:tasks.workunit.client.0.smithi104.stderr:+ ok_dir_max_entries=100 2024-09-17T04:11:10.654 INFO:tasks.workunit.client.0.smithi104.stderr:+ fail_dir_max_entries=101 2024-09-17T04:11:10.654 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_files 100 2024-09-17T04:11:10.654 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:10.670 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.670 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.670 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.003707 s, 0.0 kB/s 2024-09-17T04:11:10.674 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.674 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.674 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00219087 s, 0.0 kB/s 2024-09-17T04:11:10.679 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.679 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.679 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00218282 s, 0.0 kB/s 2024-09-17T04:11:10.684 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.684 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.684 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205669 s, 0.0 kB/s 2024-09-17T04:11:10.688 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.688 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.688 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196206 s, 0.0 kB/s 2024-09-17T04:11:10.693 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.693 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.693 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196954 s, 0.0 kB/s 2024-09-17T04:11:10.697 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.697 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.697 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214763 s, 0.0 kB/s 2024-09-17T04:11:10.702 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.702 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.702 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212335 s, 0.0 kB/s 2024-09-17T04:11:10.707 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.707 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.707 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00232229 s, 0.0 kB/s 2024-09-17T04:11:10.711 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.711 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.711 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204733 s, 0.0 kB/s 2024-09-17T04:11:10.716 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.716 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.716 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214552 s, 0.0 kB/s 2024-09-17T04:11:10.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.721 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201634 s, 0.0 kB/s 2024-09-17T04:11:10.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.725 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165219 s, 0.0 kB/s 2024-09-17T04:11:10.729 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.729 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.729 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203718 s, 0.0 kB/s 2024-09-17T04:11:10.733 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.733 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.733 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167474 s, 0.0 kB/s 2024-09-17T04:11:10.738 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.738 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.738 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00190334 s, 0.0 kB/s 2024-09-17T04:11:10.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.742 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167731 s, 0.0 kB/s 2024-09-17T04:11:10.746 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.746 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.746 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175596 s, 0.0 kB/s 2024-09-17T04:11:10.750 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.750 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.750 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177167 s, 0.0 kB/s 2024-09-17T04:11:10.754 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.754 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.754 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167428 s, 0.0 kB/s 2024-09-17T04:11:10.759 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.759 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.759 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201307 s, 0.0 kB/s 2024-09-17T04:11:10.766 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.766 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.766 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00423767 s, 0.0 kB/s 2024-09-17T04:11:10.770 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.770 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.770 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206705 s, 0.0 kB/s 2024-09-17T04:11:10.775 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.775 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.775 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201306 s, 0.0 kB/s 2024-09-17T04:11:10.779 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.779 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.779 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157442 s, 0.0 kB/s 2024-09-17T04:11:10.786 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.786 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.786 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00494445 s, 0.0 kB/s 2024-09-17T04:11:10.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.791 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203946 s, 0.0 kB/s 2024-09-17T04:11:10.795 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.796 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.796 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177779 s, 0.0 kB/s 2024-09-17T04:11:10.800 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.800 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.800 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182225 s, 0.0 kB/s 2024-09-17T04:11:10.804 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.804 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.805 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205321 s, 0.0 kB/s 2024-09-17T04:11:10.809 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.809 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.809 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183355 s, 0.0 kB/s 2024-09-17T04:11:10.813 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.813 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.813 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172678 s, 0.0 kB/s 2024-09-17T04:11:10.817 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.817 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.817 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00161146 s, 0.0 kB/s 2024-09-17T04:11:10.821 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.821 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.821 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196082 s, 0.0 kB/s 2024-09-17T04:11:10.826 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.826 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.826 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191334 s, 0.0 kB/s 2024-09-17T04:11:10.830 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.830 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.830 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194569 s, 0.0 kB/s 2024-09-17T04:11:10.834 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.834 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.834 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162045 s, 0.0 kB/s 2024-09-17T04:11:10.839 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.839 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.839 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194233 s, 0.0 kB/s 2024-09-17T04:11:10.843 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.843 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.843 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187704 s, 0.0 kB/s 2024-09-17T04:11:10.847 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.847 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.847 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174292 s, 0.0 kB/s 2024-09-17T04:11:10.851 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.851 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.851 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155673 s, 0.0 kB/s 2024-09-17T04:11:10.856 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.856 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.856 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173013 s, 0.0 kB/s 2024-09-17T04:11:10.860 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.860 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.860 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017948 s, 0.0 kB/s 2024-09-17T04:11:10.865 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.865 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.865 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196526 s, 0.0 kB/s 2024-09-17T04:11:10.869 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.869 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.869 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016218 s, 0.0 kB/s 2024-09-17T04:11:10.873 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.873 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.873 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187619 s, 0.0 kB/s 2024-09-17T04:11:10.877 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.877 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.877 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189824 s, 0.0 kB/s 2024-09-17T04:11:10.881 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.881 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.882 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194045 s, 0.0 kB/s 2024-09-17T04:11:10.886 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.886 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.886 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169848 s, 0.0 kB/s 2024-09-17T04:11:10.890 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.890 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.890 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178765 s, 0.0 kB/s 2024-09-17T04:11:10.894 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.894 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.894 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.001973 s, 0.0 kB/s 2024-09-17T04:11:10.898 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.898 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.899 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171775 s, 0.0 kB/s 2024-09-17T04:11:10.903 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.903 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.903 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191909 s, 0.0 kB/s 2024-09-17T04:11:10.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.907 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187592 s, 0.0 kB/s 2024-09-17T04:11:10.913 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.913 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.913 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00394902 s, 0.0 kB/s 2024-09-17T04:11:10.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.920 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00400788 s, 0.0 kB/s 2024-09-17T04:11:10.924 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.924 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.924 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00184939 s, 0.0 kB/s 2024-09-17T04:11:10.931 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.931 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.931 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00443922 s, 0.0 kB/s 2024-09-17T04:11:10.938 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.938 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.938 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00455775 s, 0.0 kB/s 2024-09-17T04:11:10.943 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.943 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.943 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168586 s, 0.0 kB/s 2024-09-17T04:11:10.947 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.947 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.947 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159978 s, 0.0 kB/s 2024-09-17T04:11:10.951 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.951 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.951 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156555 s, 0.0 kB/s 2024-09-17T04:11:10.955 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.955 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.955 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207877 s, 0.0 kB/s 2024-09-17T04:11:10.960 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.960 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.960 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016615 s, 0.0 kB/s 2024-09-17T04:11:10.964 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.964 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.964 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00184014 s, 0.0 kB/s 2024-09-17T04:11:10.968 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.968 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.968 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00149949 s, 0.0 kB/s 2024-09-17T04:11:10.972 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.972 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.972 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017814 s, 0.0 kB/s 2024-09-17T04:11:10.977 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.977 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.977 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172766 s, 0.0 kB/s 2024-09-17T04:11:10.981 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.981 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.981 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160083 s, 0.0 kB/s 2024-09-17T04:11:10.985 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.985 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.985 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177658 s, 0.0 kB/s 2024-09-17T04:11:10.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.989 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193722 s, 0.0 kB/s 2024-09-17T04:11:10.993 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.993 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.993 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181257 s, 0.0 kB/s 2024-09-17T04:11:10.997 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:10.997 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:10.997 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156542 s, 0.0 kB/s 2024-09-17T04:11:11.001 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.001 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.001 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0014861 s, 0.0 kB/s 2024-09-17T04:11:11.005 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.005 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.005 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0015175 s, 0.0 kB/s 2024-09-17T04:11:11.009 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.009 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.009 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00144259 s, 0.0 kB/s 2024-09-17T04:11:11.013 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.013 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.013 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163779 s, 0.0 kB/s 2024-09-17T04:11:11.017 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.017 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.017 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156226 s, 0.0 kB/s 2024-09-17T04:11:11.021 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.021 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.021 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157407 s, 0.0 kB/s 2024-09-17T04:11:11.025 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.025 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.025 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174902 s, 0.0 kB/s 2024-09-17T04:11:11.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.029 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191381 s, 0.0 kB/s 2024-09-17T04:11:11.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.033 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00150927 s, 0.0 kB/s 2024-09-17T04:11:11.038 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.038 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.038 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209525 s, 0.0 kB/s 2024-09-17T04:11:11.042 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.042 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.042 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018445 s, 0.0 kB/s 2024-09-17T04:11:11.046 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.046 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.046 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00161227 s, 0.0 kB/s 2024-09-17T04:11:11.050 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.050 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.050 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159557 s, 0.0 kB/s 2024-09-17T04:11:11.054 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.055 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.055 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0015785 s, 0.0 kB/s 2024-09-17T04:11:11.058 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.059 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.059 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0015993 s, 0.0 kB/s 2024-09-17T04:11:11.062 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.062 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.063 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00154968 s, 0.0 kB/s 2024-09-17T04:11:11.066 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.066 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.066 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174056 s, 0.0 kB/s 2024-09-17T04:11:11.073 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.073 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.073 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00148443 s, 0.0 kB/s 2024-09-17T04:11:11.074 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.074 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.074 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182936 s, 0.0 kB/s 2024-09-17T04:11:11.078 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.078 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.078 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00144897 s, 0.0 kB/s 2024-09-17T04:11:11.082 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.082 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.082 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180569 s, 0.0 kB/s 2024-09-17T04:11:11.086 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.086 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.086 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00147834 s, 0.0 kB/s 2024-09-17T04:11:11.093 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.093 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.093 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00446685 s, 0.0 kB/s 2024-09-17T04:11:11.097 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.097 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.097 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159796 s, 0.0 kB/s 2024-09-17T04:11:11.101 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.101 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.101 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157922 s, 0.0 kB/s 2024-09-17T04:11:11.105 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.105 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.105 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153845 s, 0.0 kB/s 2024-09-17T04:11:11.109 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.109 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.109 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159185 s, 0.0 kB/s 2024-09-17T04:11:11.110 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:11.111 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false make_files 101 2024-09-17T04:11:11.111 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:11.111 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_files 101 2024-09-17T04:11:11.111 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:11.117 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.117 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.117 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00232927 s, 0.0 kB/s 2024-09-17T04:11:11.121 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.121 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.121 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174476 s, 0.0 kB/s 2024-09-17T04:11:11.125 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.125 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.125 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160943 s, 0.0 kB/s 2024-09-17T04:11:11.129 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.129 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.129 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00154404 s, 0.0 kB/s 2024-09-17T04:11:11.133 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.134 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.134 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197718 s, 0.0 kB/s 2024-09-17T04:11:11.137 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.138 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.138 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155713 s, 0.0 kB/s 2024-09-17T04:11:11.142 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.142 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.142 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163061 s, 0.0 kB/s 2024-09-17T04:11:11.145 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.145 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.146 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162259 s, 0.0 kB/s 2024-09-17T04:11:11.149 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.149 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.150 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166285 s, 0.0 kB/s 2024-09-17T04:11:11.154 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.154 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.154 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175536 s, 0.0 kB/s 2024-09-17T04:11:11.158 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.158 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.158 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165079 s, 0.0 kB/s 2024-09-17T04:11:11.162 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.162 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.162 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174216 s, 0.0 kB/s 2024-09-17T04:11:11.166 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.166 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.166 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163621 s, 0.0 kB/s 2024-09-17T04:11:11.170 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.170 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.170 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194141 s, 0.0 kB/s 2024-09-17T04:11:11.174 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.174 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.174 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185762 s, 0.0 kB/s 2024-09-17T04:11:11.178 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.179 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.179 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018586 s, 0.0 kB/s 2024-09-17T04:11:11.183 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.183 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.183 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162586 s, 0.0 kB/s 2024-09-17T04:11:11.187 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.187 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.187 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164767 s, 0.0 kB/s 2024-09-17T04:11:11.190 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.191 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.191 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151465 s, 0.0 kB/s 2024-09-17T04:11:11.194 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.195 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.195 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173005 s, 0.0 kB/s 2024-09-17T04:11:11.199 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.199 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.199 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167643 s, 0.0 kB/s 2024-09-17T04:11:11.206 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.206 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.206 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00425338 s, 0.0 kB/s 2024-09-17T04:11:11.210 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.210 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.210 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199108 s, 0.0 kB/s 2024-09-17T04:11:11.214 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.214 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.214 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156814 s, 0.0 kB/s 2024-09-17T04:11:11.218 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.218 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.218 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00147766 s, 0.0 kB/s 2024-09-17T04:11:11.222 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.223 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.223 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174142 s, 0.0 kB/s 2024-09-17T04:11:11.226 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.226 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.227 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00147384 s, 0.0 kB/s 2024-09-17T04:11:11.231 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.231 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.231 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191329 s, 0.0 kB/s 2024-09-17T04:11:11.234 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.235 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.235 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151518 s, 0.0 kB/s 2024-09-17T04:11:11.239 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.239 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.239 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159647 s, 0.0 kB/s 2024-09-17T04:11:11.243 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.243 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.243 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151462 s, 0.0 kB/s 2024-09-17T04:11:11.247 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.247 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.247 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177381 s, 0.0 kB/s 2024-09-17T04:11:11.251 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.252 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.252 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174341 s, 0.0 kB/s 2024-09-17T04:11:11.256 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.256 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.256 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162849 s, 0.0 kB/s 2024-09-17T04:11:11.259 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.260 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.260 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155465 s, 0.0 kB/s 2024-09-17T04:11:11.263 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.264 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.264 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166168 s, 0.0 kB/s 2024-09-17T04:11:11.268 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.268 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.268 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0014925 s, 0.0 kB/s 2024-09-17T04:11:11.272 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.272 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.272 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187656 s, 0.0 kB/s 2024-09-17T04:11:11.276 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.276 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.276 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191341 s, 0.0 kB/s 2024-09-17T04:11:11.280 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.280 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.280 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187467 s, 0.0 kB/s 2024-09-17T04:11:11.285 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.285 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.285 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188683 s, 0.0 kB/s 2024-09-17T04:11:11.289 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.289 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.289 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187873 s, 0.0 kB/s 2024-09-17T04:11:11.293 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.293 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.293 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00152961 s, 0.0 kB/s 2024-09-17T04:11:11.297 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.297 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.297 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181761 s, 0.0 kB/s 2024-09-17T04:11:11.301 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.301 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.301 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159944 s, 0.0 kB/s 2024-09-17T04:11:11.305 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.305 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.305 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019426 s, 0.0 kB/s 2024-09-17T04:11:11.309 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.309 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.309 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153764 s, 0.0 kB/s 2024-09-17T04:11:11.313 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.314 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.314 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171402 s, 0.0 kB/s 2024-09-17T04:11:11.317 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.317 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.318 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00148912 s, 0.0 kB/s 2024-09-17T04:11:11.321 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.321 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.322 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153693 s, 0.0 kB/s 2024-09-17T04:11:11.325 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.325 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.325 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176395 s, 0.0 kB/s 2024-09-17T04:11:11.330 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.330 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.330 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174302 s, 0.0 kB/s 2024-09-17T04:11:11.334 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.334 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.334 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186309 s, 0.0 kB/s 2024-09-17T04:11:11.338 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.338 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.338 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195943 s, 0.0 kB/s 2024-09-17T04:11:11.343 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.343 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.343 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203877 s, 0.0 kB/s 2024-09-17T04:11:11.346 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.346 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.347 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151424 s, 0.0 kB/s 2024-09-17T04:11:11.350 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.351 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.351 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163281 s, 0.0 kB/s 2024-09-17T04:11:11.354 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.354 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.354 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0014492 s, 0.0 kB/s 2024-09-17T04:11:11.358 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.358 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.358 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157516 s, 0.0 kB/s 2024-09-17T04:11:11.362 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.362 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.362 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151485 s, 0.0 kB/s 2024-09-17T04:11:11.367 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.367 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.367 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00208128 s, 0.0 kB/s 2024-09-17T04:11:11.371 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.371 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.371 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174991 s, 0.0 kB/s 2024-09-17T04:11:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.375 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019372 s, 0.0 kB/s 2024-09-17T04:11:11.379 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.379 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.379 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153772 s, 0.0 kB/s 2024-09-17T04:11:11.383 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.383 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.383 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156574 s, 0.0 kB/s 2024-09-17T04:11:11.386 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.387 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.387 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160177 s, 0.0 kB/s 2024-09-17T04:11:11.390 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.390 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.390 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00158279 s, 0.0 kB/s 2024-09-17T04:11:11.394 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.394 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.394 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157484 s, 0.0 kB/s 2024-09-17T04:11:11.398 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.398 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.399 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168293 s, 0.0 kB/s 2024-09-17T04:11:11.402 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.402 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.402 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169611 s, 0.0 kB/s 2024-09-17T04:11:11.407 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.407 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.407 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166063 s, 0.0 kB/s 2024-09-17T04:11:11.410 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.411 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.411 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00148635 s, 0.0 kB/s 2024-09-17T04:11:11.414 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.414 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.415 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0015377 s, 0.0 kB/s 2024-09-17T04:11:11.418 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.419 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174948 s, 0.0 kB/s 2024-09-17T04:11:11.422 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.422 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.423 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162035 s, 0.0 kB/s 2024-09-17T04:11:11.426 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.426 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.427 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162624 s, 0.0 kB/s 2024-09-17T04:11:11.430 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.430 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.431 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173604 s, 0.0 kB/s 2024-09-17T04:11:11.434 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.435 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.435 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017879 s, 0.0 kB/s 2024-09-17T04:11:11.438 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.438 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.438 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164612 s, 0.0 kB/s 2024-09-17T04:11:11.442 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.443 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.443 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186554 s, 0.0 kB/s 2024-09-17T04:11:11.447 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.447 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.447 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170161 s, 0.0 kB/s 2024-09-17T04:11:11.451 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.451 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.451 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163663 s, 0.0 kB/s 2024-09-17T04:11:11.455 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.455 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.455 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197306 s, 0.0 kB/s 2024-09-17T04:11:11.459 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.459 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.459 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.001625 s, 0.0 kB/s 2024-09-17T04:11:11.463 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.463 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.463 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00192688 s, 0.0 kB/s 2024-09-17T04:11:11.467 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.467 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.467 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159161 s, 0.0 kB/s 2024-09-17T04:11:11.471 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.471 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.472 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020651 s, 0.0 kB/s 2024-09-17T04:11:11.476 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.477 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.477 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00200903 s, 0.0 kB/s 2024-09-17T04:11:11.480 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.480 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.480 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193665 s, 0.0 kB/s 2024-09-17T04:11:11.484 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.484 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.484 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00151026 s, 0.0 kB/s 2024-09-17T04:11:11.488 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.488 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.489 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00208527 s, 0.0 kB/s 2024-09-17T04:11:11.493 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.493 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.493 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187714 s, 0.0 kB/s 2024-09-17T04:11:11.497 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.497 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.497 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166089 s, 0.0 kB/s 2024-09-17T04:11:11.501 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.501 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.501 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187799 s, 0.0 kB/s 2024-09-17T04:11:11.506 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.506 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.506 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019242 s, 0.0 kB/s 2024-09-17T04:11:11.509 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.509 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.510 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164187 s, 0.0 kB/s 2024-09-17T04:11:11.514 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.514 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.514 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178478 s, 0.0 kB/s 2024-09-17T04:11:11.518 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.518 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.518 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169797 s, 0.0 kB/s 2024-09-17T04:11:11.522 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.522 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.522 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153569 s, 0.0 kB/s 2024-09-17T04:11:11.526 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:11.526 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:11.526 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171306 s, 0.0 kB/s 2024-09-17T04:11:11.528 INFO:tasks.workunit.client.0.smithi104.stderr:dd: failed to open 'mkfile_test_N1EKkn/file_101': No space left on device 2024-09-17T04:11:11.956 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:11.956 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false make_dirs 101 2024-09-17T04:11:11.957 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:11.957 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_dirs 101 2024-09-17T04:11:11.957 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:12.379 INFO:tasks.workunit.client.0.smithi104.stderr:mkdir: cannot create directory ‘mkdir_test_HMrln4/dir_101’: No space left on device 2024-09-17T04:11:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false make_nodes 101 2024-09-17T04:11:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_nodes 101 2024-09-17T04:11:12.805 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:13.278 INFO:tasks.workunit.client.0.smithi104.stderr:mknod: mknod_test_qL8lSA/fifo_101: No space left on device 2024-09-17T04:11:13.986 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:13.986 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false rename_files 101 2024-09-17T04:11:13.986 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:13.987 INFO:tasks.workunit.client.0.smithi104.stderr:+ rename_files 101 2024-09-17T04:11:13.987 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:14.697 INFO:tasks.workunit.client.0.smithi104.stderr:mv: cannot move 'rename_test_bTqOmD/file_101' to 'rename_test_bTqOmD/rename/file_101': No space left on device 2024-09-17T04:11:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false make_symlinks 101 2024-09-17T04:11:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_symlinks 101 2024-09-17T04:11:14.953 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:15.246 INFO:tasks.workunit.client.0.smithi104.stderr:ln: failed to create symbolic link 'symlink_test_lzRQ5c/symlink/sym_101': No space left on device 2024-09-17T04:11:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:+ expect_false make_links 101 2024-09-17T04:11:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:+ set -x 2024-09-17T04:11:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_links 101 2024-09-17T04:11:15.554 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:19.364 INFO:tasks.workunit.client.0.smithi104.stderr:ln: failed to create hard link 'link_test_oo5mIB/link/link_101': No space left on device 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 -- 172.21.15.104:0/3594802850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1970162300 msgr2=0x7f1970162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 --2- 172.21.15.104:0/3594802850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1970162300 0x7f1970162710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1968009830 tx=0x7f196802a480 comp rx=0 tx=0).stop 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 -- 172.21.15.104:0/3594802850 shutdown_connections 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 --2- 172.21.15.104:0/3594802850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1970162300 0x7f1970162710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 --2- 172.21.15.104:0/3594802850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f197015f9e0 0x7f197006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 -- 172.21.15.104:0/3594802850 >> 172.21.15.104:0/3594802850 conn(0x7f19700d4a80 msgr2=0x7f19700b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:19.472 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 -- 172.21.15.104:0/3594802850 shutdown_connections 2024-09-17T04:11:19.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.472+0000 7f197499d640 1 -- 172.21.15.104:0/3594802850 wait complete. 2024-09-17T04:11:19.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.473+0000 7f197499d640 1 Processor -- start 2024-09-17T04:11:19.473 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.474+0000 7f197499d640 1 -- start start 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 0x7f1970153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1970162300 0x7f19700b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f197006d0f0 con 0x7f19700d2f80 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f197006cf70 con 0x7f197015f9e0 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f197499d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f197006d270 con 0x7f1970162300 2024-09-17T04:11:19.476 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41070/0 (socket says 172.21.15.104:41070) 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 -- 172.21.15.104:0/3510297897 learned_addr learned my addr 172.21.15.104:0/3510297897 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196ffff640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1970162300 0x7f19700b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196effd640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 0x7f1970153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 -- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1970162300 msgr2=0x7f19700b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1970162300 0x7f19700b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 -- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 msgr2=0x7f1970153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 0x7f1970153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196f7fe640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1970151070 con 0x7f19700d2f80 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.475+0000 7f196effd640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 0x7f1970153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f196f7fe640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f196000daf0 tx=0x7f196000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960017070 con 0x7f19700d2f80 2024-09-17T04:11:19.477 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1960003970 con 0x7f19700d2f80 2024-09-17T04:11:19.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960003dc0 con 0x7f19700d2f80 2024-09-17T04:11:19.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1970150d90 con 0x7f19700d2f80 2024-09-17T04:11:19.478 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.476+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19701f5fb0 con 0x7f19700d2f80 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.477+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197006e540 con 0x7f19700d2f80 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.478+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1960004020 con 0x7f19700d2f80 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.478+0000 7f1957fff640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 0x7f195c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.478+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f196009b680 con 0x7f19700d2f80 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.478+0000 7f196effd640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 0x7f195c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:19.479 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.479+0000 7f196effd640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 0x7f195c07b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f197006aa70 tx=0x7f1964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:19.482 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.483+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1960020030 con 0x7f19700d2f80 2024-09-17T04:11:19.658 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.658+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) -- 0x7f1970158c00 con 0x7f19700d2f80 2024-09-17T04:11:19.661 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.662+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v33)=0 v33) ==== 117+0+0 (secure 0 0 0) 0x7f196006ae20 con 0x7f19700d2f80 2024-09-17T04:11:19.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.765+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) -- 0x7f1970158920 con 0x7f19700d2f80 2024-09-17T04:11:19.765 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.766+0000 7f1957fff640 1 -- 172.21.15.104:0/3510297897 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v33)=0 v33) ==== 117+0+0 (secure 0 0 0) 0x7f1960063750 con 0x7f19700d2f80 2024-09-17T04:11:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 msgr2=0x7f195c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 0x7f195c07b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f197006aa70 tx=0x7f1964009040 comp rx=0 tx=0).stop 2024-09-17T04:11:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 msgr2=0x7f19701537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:19.769 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f196000daf0 tx=0x7f196000b260 comp rx=0 tx=0).stop 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 shutdown_connections 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f195c078bc0 0x7f195c07b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197015f9e0 0x7f1970153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1970162300 0x7f19700b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 --2- 172.21.15.104:0/3510297897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19700d2f80 0x7f19701537c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 >> 172.21.15.104:0/3510297897 conn(0x7f19700d4a80 msgr2=0x7f19700b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:19.770 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 shutdown_connections 2024-09-17T04:11:19.771 INFO:tasks.workunit.client.0.smithi104.stderr:2024-09-17T04:11:19.768+0000 7f197499d640 1 -- 172.21.15.104:0/3510297897 wait complete. 2024-09-17T04:11:19.787 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.787 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.787 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00335733 s, 0.0 kB/s 2024-09-17T04:11:19.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.791 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00202144 s, 0.0 kB/s 2024-09-17T04:11:19.795 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.796 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.796 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177586 s, 0.0 kB/s 2024-09-17T04:11:19.801 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.801 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.801 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00250625 s, 0.0 kB/s 2024-09-17T04:11:19.805 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.805 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.805 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196093 s, 0.0 kB/s 2024-09-17T04:11:19.810 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.810 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.810 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00233696 s, 0.0 kB/s 2024-09-17T04:11:19.815 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.815 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.815 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0025977 s, 0.0 kB/s 2024-09-17T04:11:19.820 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.820 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.820 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00218065 s, 0.0 kB/s 2024-09-17T04:11:19.825 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.825 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.825 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00216252 s, 0.0 kB/s 2024-09-17T04:11:19.829 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.829 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.829 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185001 s, 0.0 kB/s 2024-09-17T04:11:19.834 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.834 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.834 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00223984 s, 0.0 kB/s 2024-09-17T04:11:19.839 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.839 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.839 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00243558 s, 0.0 kB/s 2024-09-17T04:11:19.844 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.844 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.844 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00248452 s, 0.0 kB/s 2024-09-17T04:11:19.848 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.849 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.849 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00230435 s, 0.0 kB/s 2024-09-17T04:11:19.855 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.856 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.856 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00345968 s, 0.0 kB/s 2024-09-17T04:11:19.860 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.860 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.860 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.001861 s, 0.0 kB/s 2024-09-17T04:11:19.865 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.865 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.865 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00234438 s, 0.0 kB/s 2024-09-17T04:11:19.869 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.869 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.869 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182824 s, 0.0 kB/s 2024-09-17T04:11:19.874 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.874 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.874 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00210377 s, 0.0 kB/s 2024-09-17T04:11:19.878 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.878 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.878 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183665 s, 0.0 kB/s 2024-09-17T04:11:19.882 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.882 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.882 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185251 s, 0.0 kB/s 2024-09-17T04:11:19.886 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.887 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.887 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173927 s, 0.0 kB/s 2024-09-17T04:11:19.891 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.891 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.891 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187971 s, 0.0 kB/s 2024-09-17T04:11:19.895 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.895 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.896 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207441 s, 0.0 kB/s 2024-09-17T04:11:19.900 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.900 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.900 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00211754 s, 0.0 kB/s 2024-09-17T04:11:19.905 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.905 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.905 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201003 s, 0.0 kB/s 2024-09-17T04:11:19.909 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.909 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.909 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00190064 s, 0.0 kB/s 2024-09-17T04:11:19.914 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.914 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.914 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207947 s, 0.0 kB/s 2024-09-17T04:11:19.918 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.919 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.919 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180895 s, 0.0 kB/s 2024-09-17T04:11:19.923 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.923 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.923 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166936 s, 0.0 kB/s 2024-09-17T04:11:19.927 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.927 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.927 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0021203 s, 0.0 kB/s 2024-09-17T04:11:19.932 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.932 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.932 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167602 s, 0.0 kB/s 2024-09-17T04:11:19.936 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.936 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.936 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175601 s, 0.0 kB/s 2024-09-17T04:11:19.940 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.940 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.941 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168693 s, 0.0 kB/s 2024-09-17T04:11:19.944 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.944 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.945 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166448 s, 0.0 kB/s 2024-09-17T04:11:19.949 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.949 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.949 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188526 s, 0.0 kB/s 2024-09-17T04:11:19.953 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.953 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.953 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185736 s, 0.0 kB/s 2024-09-17T04:11:19.958 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.958 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.958 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203265 s, 0.0 kB/s 2024-09-17T04:11:19.962 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.962 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.963 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00211565 s, 0.0 kB/s 2024-09-17T04:11:19.967 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.967 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.967 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212982 s, 0.0 kB/s 2024-09-17T04:11:19.971 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.971 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.972 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00211121 s, 0.0 kB/s 2024-09-17T04:11:19.976 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.976 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.976 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172525 s, 0.0 kB/s 2024-09-17T04:11:19.980 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.980 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.980 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185229 s, 0.0 kB/s 2024-09-17T04:11:19.984 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.984 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.984 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00200712 s, 0.0 kB/s 2024-09-17T04:11:19.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.989 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174362 s, 0.0 kB/s 2024-09-17T04:11:19.993 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.993 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.993 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177975 s, 0.0 kB/s 2024-09-17T04:11:19.997 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:19.997 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:19.998 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212243 s, 0.0 kB/s 2024-09-17T04:11:20.002 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.002 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.002 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167587 s, 0.0 kB/s 2024-09-17T04:11:20.006 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.006 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.006 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193088 s, 0.0 kB/s 2024-09-17T04:11:20.010 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.010 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.010 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189137 s, 0.0 kB/s 2024-09-17T04:11:20.015 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.015 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.015 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173146 s, 0.0 kB/s 2024-09-17T04:11:20.019 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.019 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.019 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186374 s, 0.0 kB/s 2024-09-17T04:11:20.023 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.023 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.023 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166683 s, 0.0 kB/s 2024-09-17T04:11:20.028 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.028 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.028 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00222445 s, 0.0 kB/s 2024-09-17T04:11:20.032 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.032 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.032 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.001888 s, 0.0 kB/s 2024-09-17T04:11:20.036 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.036 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.037 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191809 s, 0.0 kB/s 2024-09-17T04:11:20.041 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.041 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.041 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187156 s, 0.0 kB/s 2024-09-17T04:11:20.045 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.045 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.045 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018451 s, 0.0 kB/s 2024-09-17T04:11:20.050 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.050 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.050 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00232388 s, 0.0 kB/s 2024-09-17T04:11:20.054 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.055 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.055 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020613 s, 0.0 kB/s 2024-09-17T04:11:20.059 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.059 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.059 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182171 s, 0.0 kB/s 2024-09-17T04:11:20.063 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.063 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.063 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207824 s, 0.0 kB/s 2024-09-17T04:11:20.067 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.068 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.068 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169041 s, 0.0 kB/s 2024-09-17T04:11:20.072 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.072 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.072 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178301 s, 0.0 kB/s 2024-09-17T04:11:20.076 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.076 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.076 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193674 s, 0.0 kB/s 2024-09-17T04:11:20.081 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.081 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.081 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0029067 s, 0.0 kB/s 2024-09-17T04:11:20.086 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.086 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.086 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0021889 s, 0.0 kB/s 2024-09-17T04:11:20.090 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.090 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.091 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176129 s, 0.0 kB/s 2024-09-17T04:11:20.094 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.095 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.095 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169813 s, 0.0 kB/s 2024-09-17T04:11:20.099 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.099 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.099 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165623 s, 0.0 kB/s 2024-09-17T04:11:20.103 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.103 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.104 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194041 s, 0.0 kB/s 2024-09-17T04:11:20.108 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.108 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.108 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214336 s, 0.0 kB/s 2024-09-17T04:11:20.112 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.112 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.112 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174774 s, 0.0 kB/s 2024-09-17T04:11:20.116 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.116 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.116 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016761 s, 0.0 kB/s 2024-09-17T04:11:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.121 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199275 s, 0.0 kB/s 2024-09-17T04:11:20.125 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.125 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.125 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173906 s, 0.0 kB/s 2024-09-17T04:11:20.129 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.129 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.130 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187241 s, 0.0 kB/s 2024-09-17T04:11:20.133 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.134 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.134 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167116 s, 0.0 kB/s 2024-09-17T04:11:20.138 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.138 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.138 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016072 s, 0.0 kB/s 2024-09-17T04:11:20.142 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.142 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.142 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00202926 s, 0.0 kB/s 2024-09-17T04:11:20.147 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.147 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.147 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00245453 s, 0.0 kB/s 2024-09-17T04:11:20.151 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.152 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172213 s, 0.0 kB/s 2024-09-17T04:11:20.162 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.162 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.162 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00799148 s, 0.0 kB/s 2024-09-17T04:11:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.167 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185331 s, 0.0 kB/s 2024-09-17T04:11:20.171 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.171 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.172 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204293 s, 0.0 kB/s 2024-09-17T04:11:20.175 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.176 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.176 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166128 s, 0.0 kB/s 2024-09-17T04:11:20.180 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.180 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.180 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173477 s, 0.0 kB/s 2024-09-17T04:11:20.184 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.184 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.184 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00192793 s, 0.0 kB/s 2024-09-17T04:11:20.189 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.189 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.189 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00208507 s, 0.0 kB/s 2024-09-17T04:11:20.194 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.194 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.195 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0024144 s, 0.0 kB/s 2024-09-17T04:11:20.199 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.199 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.199 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00220059 s, 0.0 kB/s 2024-09-17T04:11:20.203 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.204 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.204 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165693 s, 0.0 kB/s 2024-09-17T04:11:20.208 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.208 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.208 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174293 s, 0.0 kB/s 2024-09-17T04:11:20.212 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.212 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.213 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00221362 s, 0.0 kB/s 2024-09-17T04:11:20.217 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.217 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.217 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176399 s, 0.0 kB/s 2024-09-17T04:11:20.221 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.221 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.221 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016359 s, 0.0 kB/s 2024-09-17T04:11:20.225 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.225 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.225 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174454 s, 0.0 kB/s 2024-09-17T04:11:20.229 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.229 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.229 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00161736 s, 0.0 kB/s 2024-09-17T04:11:20.233 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.233 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.233 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167081 s, 0.0 kB/s 2024-09-17T04:11:20.237 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.237 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.237 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163236 s, 0.0 kB/s 2024-09-17T04:11:20.242 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.243 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.243 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00298171 s, 0.0 kB/s 2024-09-17T04:11:20.247 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.247 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.247 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00179963 s, 0.0 kB/s 2024-09-17T04:11:20.251 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.252 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.252 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182641 s, 0.0 kB/s 2024-09-17T04:11:20.256 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.256 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.256 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020064 s, 0.0 kB/s 2024-09-17T04:11:20.260 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.260 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.261 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175954 s, 0.0 kB/s 2024-09-17T04:11:20.265 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.265 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.265 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172668 s, 0.0 kB/s 2024-09-17T04:11:20.269 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.270 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.270 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209173 s, 0.0 kB/s 2024-09-17T04:11:20.274 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.274 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.274 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185859 s, 0.0 kB/s 2024-09-17T04:11:20.279 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.279 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.279 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00221912 s, 0.0 kB/s 2024-09-17T04:11:20.283 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.283 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.283 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186726 s, 0.0 kB/s 2024-09-17T04:11:20.288 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.288 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.288 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00210017 s, 0.0 kB/s 2024-09-17T04:11:20.292 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.292 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.292 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177113 s, 0.0 kB/s 2024-09-17T04:11:20.296 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.297 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.297 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194275 s, 0.0 kB/s 2024-09-17T04:11:20.301 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.301 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.301 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189438 s, 0.0 kB/s 2024-09-17T04:11:20.305 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.305 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.305 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00210821 s, 0.0 kB/s 2024-09-17T04:11:20.310 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.310 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.310 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00192036 s, 0.0 kB/s 2024-09-17T04:11:20.314 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.314 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.314 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197568 s, 0.0 kB/s 2024-09-17T04:11:20.318 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.319 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.319 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00190252 s, 0.0 kB/s 2024-09-17T04:11:20.322 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.322 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.323 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164547 s, 0.0 kB/s 2024-09-17T04:11:20.327 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.327 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.327 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019635 s, 0.0 kB/s 2024-09-17T04:11:20.331 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.331 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.331 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183549 s, 0.0 kB/s 2024-09-17T04:11:20.336 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.336 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.336 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206307 s, 0.0 kB/s 2024-09-17T04:11:20.340 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.340 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.340 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162378 s, 0.0 kB/s 2024-09-17T04:11:20.344 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.344 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.344 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171543 s, 0.0 kB/s 2024-09-17T04:11:20.349 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.350 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.350 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00238252 s, 0.0 kB/s 2024-09-17T04:11:20.354 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.354 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.355 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00217918 s, 0.0 kB/s 2024-09-17T04:11:20.359 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.359 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.359 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172349 s, 0.0 kB/s 2024-09-17T04:11:20.363 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.363 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.363 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167979 s, 0.0 kB/s 2024-09-17T04:11:20.367 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.368 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.368 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191402 s, 0.0 kB/s 2024-09-17T04:11:20.372 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.372 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.372 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206705 s, 0.0 kB/s 2024-09-17T04:11:20.376 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.377 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.377 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203402 s, 0.0 kB/s 2024-09-17T04:11:20.381 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.381 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.381 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186052 s, 0.0 kB/s 2024-09-17T04:11:20.385 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.385 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.385 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203218 s, 0.0 kB/s 2024-09-17T04:11:20.390 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.390 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.390 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00223723 s, 0.0 kB/s 2024-09-17T04:11:20.394 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.394 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.394 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176748 s, 0.0 kB/s 2024-09-17T04:11:20.398 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.398 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.399 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017248 s, 0.0 kB/s 2024-09-17T04:11:20.403 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.403 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.403 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181913 s, 0.0 kB/s 2024-09-17T04:11:20.408 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.408 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.408 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00227621 s, 0.0 kB/s 2024-09-17T04:11:20.412 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.412 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.412 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165592 s, 0.0 kB/s 2024-09-17T04:11:20.416 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.416 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.416 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170531 s, 0.0 kB/s 2024-09-17T04:11:20.421 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.422 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.422 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207738 s, 0.0 kB/s 2024-09-17T04:11:20.426 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.426 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.426 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174125 s, 0.0 kB/s 2024-09-17T04:11:20.430 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.430 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.430 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167196 s, 0.0 kB/s 2024-09-17T04:11:20.434 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.434 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.434 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171723 s, 0.0 kB/s 2024-09-17T04:11:20.439 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.439 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.439 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020217 s, 0.0 kB/s 2024-09-17T04:11:20.444 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.444 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.444 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00264098 s, 0.0 kB/s 2024-09-17T04:11:20.448 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.448 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.448 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168222 s, 0.0 kB/s 2024-09-17T04:11:20.452 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.453 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.453 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017606 s, 0.0 kB/s 2024-09-17T04:11:20.457 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.457 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.457 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172283 s, 0.0 kB/s 2024-09-17T04:11:20.461 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.461 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.461 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201405 s, 0.0 kB/s 2024-09-17T04:11:20.466 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.466 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.466 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00260982 s, 0.0 kB/s 2024-09-17T04:11:20.471 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.471 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.471 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196408 s, 0.0 kB/s 2024-09-17T04:11:20.475 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.475 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.475 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165951 s, 0.0 kB/s 2024-09-17T04:11:20.479 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.480 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.480 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020821 s, 0.0 kB/s 2024-09-17T04:11:20.484 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.484 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.484 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164369 s, 0.0 kB/s 2024-09-17T04:11:20.488 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.488 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.488 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197326 s, 0.0 kB/s 2024-09-17T04:11:20.493 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.493 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.493 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00240933 s, 0.0 kB/s 2024-09-17T04:11:20.497 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.497 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.497 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167333 s, 0.0 kB/s 2024-09-17T04:11:20.501 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.501 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.501 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172598 s, 0.0 kB/s 2024-09-17T04:11:20.505 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.506 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.506 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017259 s, 0.0 kB/s 2024-09-17T04:11:20.510 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.510 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.510 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193343 s, 0.0 kB/s 2024-09-17T04:11:20.514 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.514 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.514 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198793 s, 0.0 kB/s 2024-09-17T04:11:20.518 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.519 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.519 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017009 s, 0.0 kB/s 2024-09-17T04:11:20.523 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.523 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.523 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019238 s, 0.0 kB/s 2024-09-17T04:11:20.527 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.527 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.527 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019281 s, 0.0 kB/s 2024-09-17T04:11:20.531 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.532 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.532 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166427 s, 0.0 kB/s 2024-09-17T04:11:20.535 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.536 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.536 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176228 s, 0.0 kB/s 2024-09-17T04:11:20.540 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.540 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.540 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160422 s, 0.0 kB/s 2024-09-17T04:11:20.544 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.544 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.544 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173959 s, 0.0 kB/s 2024-09-17T04:11:20.548 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.548 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.548 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167061 s, 0.0 kB/s 2024-09-17T04:11:20.552 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.552 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.552 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174153 s, 0.0 kB/s 2024-09-17T04:11:20.556 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.556 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.557 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170419 s, 0.0 kB/s 2024-09-17T04:11:20.561 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.561 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.561 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170711 s, 0.0 kB/s 2024-09-17T04:11:20.565 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.565 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.565 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194984 s, 0.0 kB/s 2024-09-17T04:11:20.569 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.569 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.569 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017501 s, 0.0 kB/s 2024-09-17T04:11:20.573 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.573 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.573 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166686 s, 0.0 kB/s 2024-09-17T04:11:20.577 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.577 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.577 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178156 s, 0.0 kB/s 2024-09-17T04:11:20.581 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.582 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.582 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186058 s, 0.0 kB/s 2024-09-17T04:11:20.585 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.586 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.586 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172796 s, 0.0 kB/s 2024-09-17T04:11:20.590 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.590 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.590 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168816 s, 0.0 kB/s 2024-09-17T04:11:20.595 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.595 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.595 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176816 s, 0.0 kB/s 2024-09-17T04:11:20.600 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.600 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.600 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204144 s, 0.0 kB/s 2024-09-17T04:11:20.605 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.605 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.605 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020833 s, 0.0 kB/s 2024-09-17T04:11:20.609 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.609 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.610 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185626 s, 0.0 kB/s 2024-09-17T04:11:20.614 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.614 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.614 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0021097 s, 0.0 kB/s 2024-09-17T04:11:20.619 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.619 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.619 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167439 s, 0.0 kB/s 2024-09-17T04:11:20.624 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.624 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.624 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00233818 s, 0.0 kB/s 2024-09-17T04:11:20.629 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.629 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.629 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191054 s, 0.0 kB/s 2024-09-17T04:11:20.634 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.634 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.634 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205264 s, 0.0 kB/s 2024-09-17T04:11:20.639 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.639 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.639 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206073 s, 0.0 kB/s 2024-09-17T04:11:20.643 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.643 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.643 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195122 s, 0.0 kB/s 2024-09-17T04:11:20.648 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.648 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.648 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162205 s, 0.0 kB/s 2024-09-17T04:11:20.653 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.653 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.653 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212461 s, 0.0 kB/s 2024-09-17T04:11:20.658 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.658 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.658 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207698 s, 0.0 kB/s 2024-09-17T04:11:20.663 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.663 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.663 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196201 s, 0.0 kB/s 2024-09-17T04:11:20.668 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.668 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.668 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00200392 s, 0.0 kB/s 2024-09-17T04:11:20.672 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.673 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.673 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199416 s, 0.0 kB/s 2024-09-17T04:11:20.678 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.678 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.678 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00284541 s, 0.0 kB/s 2024-09-17T04:11:20.685 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.685 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.685 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00268505 s, 0.0 kB/s 2024-09-17T04:11:20.690 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.690 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.690 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196768 s, 0.0 kB/s 2024-09-17T04:11:20.695 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.695 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.695 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186229 s, 0.0 kB/s 2024-09-17T04:11:20.700 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.700 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.700 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194053 s, 0.0 kB/s 2024-09-17T04:11:20.704 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.705 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.705 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201715 s, 0.0 kB/s 2024-09-17T04:11:20.710 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.710 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.710 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00213165 s, 0.0 kB/s 2024-09-17T04:11:20.714 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.715 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.715 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00196966 s, 0.0 kB/s 2024-09-17T04:11:20.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.720 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00192716 s, 0.0 kB/s 2024-09-17T04:11:20.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.725 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209456 s, 0.0 kB/s 2024-09-17T04:11:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.730 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00228059 s, 0.0 kB/s 2024-09-17T04:11:20.736 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.736 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.737 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00314558 s, 0.0 kB/s 2024-09-17T04:11:20.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.742 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00221926 s, 0.0 kB/s 2024-09-17T04:11:20.747 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.747 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.747 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00213923 s, 0.0 kB/s 2024-09-17T04:11:20.751 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.752 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.752 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207775 s, 0.0 kB/s 2024-09-17T04:11:20.757 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.757 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.757 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209149 s, 0.0 kB/s 2024-09-17T04:11:20.761 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.761 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.762 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198275 s, 0.0 kB/s 2024-09-17T04:11:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.766 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189258 s, 0.0 kB/s 2024-09-17T04:11:20.771 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.771 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.771 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189364 s, 0.0 kB/s 2024-09-17T04:11:20.776 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.776 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.776 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197957 s, 0.0 kB/s 2024-09-17T04:11:20.781 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.781 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.781 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187381 s, 0.0 kB/s 2024-09-17T04:11:20.786 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.786 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.786 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214962 s, 0.0 kB/s 2024-09-17T04:11:20.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.791 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.791 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00200749 s, 0.0 kB/s 2024-09-17T04:11:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.796 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205202 s, 0.0 kB/s 2024-09-17T04:11:20.801 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.802 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.802 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180831 s, 0.0 kB/s 2024-09-17T04:11:20.806 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.806 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.806 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197276 s, 0.0 kB/s 2024-09-17T04:11:20.811 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.811 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.811 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173826 s, 0.0 kB/s 2024-09-17T04:11:20.816 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.816 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.816 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209216 s, 0.0 kB/s 2024-09-17T04:11:20.821 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.821 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.821 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212672 s, 0.0 kB/s 2024-09-17T04:11:20.825 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.826 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172201 s, 0.0 kB/s 2024-09-17T04:11:20.831 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.831 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.831 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.002556 s, 0.0 kB/s 2024-09-17T04:11:20.835 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.836 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.836 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197753 s, 0.0 kB/s 2024-09-17T04:11:20.840 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.840 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.840 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00210703 s, 0.0 kB/s 2024-09-17T04:11:20.845 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.845 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.845 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176467 s, 0.0 kB/s 2024-09-17T04:11:20.849 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.849 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.850 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206936 s, 0.0 kB/s 2024-09-17T04:11:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.854 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183294 s, 0.0 kB/s 2024-09-17T04:11:20.858 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.858 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.858 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00211952 s, 0.0 kB/s 2024-09-17T04:11:20.862 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.862 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.862 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165852 s, 0.0 kB/s 2024-09-17T04:11:20.867 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.867 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.867 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189205 s, 0.0 kB/s 2024-09-17T04:11:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.871 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199261 s, 0.0 kB/s 2024-09-17T04:11:20.876 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.876 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.876 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206025 s, 0.0 kB/s 2024-09-17T04:11:20.880 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.880 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.881 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206994 s, 0.0 kB/s 2024-09-17T04:11:20.885 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.885 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.885 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189728 s, 0.0 kB/s 2024-09-17T04:11:20.889 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.889 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.889 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182578 s, 0.0 kB/s 2024-09-17T04:11:20.893 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.893 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.894 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00208893 s, 0.0 kB/s 2024-09-17T04:11:20.898 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.898 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.898 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00203949 s, 0.0 kB/s 2024-09-17T04:11:20.902 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.903 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.903 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188264 s, 0.0 kB/s 2024-09-17T04:11:20.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.907 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00215967 s, 0.0 kB/s 2024-09-17T04:11:20.911 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.911 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.912 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171513 s, 0.0 kB/s 2024-09-17T04:11:20.915 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.916 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.916 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176133 s, 0.0 kB/s 2024-09-17T04:11:20.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.920 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180873 s, 0.0 kB/s 2024-09-17T04:11:20.925 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.925 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.925 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209682 s, 0.0 kB/s 2024-09-17T04:11:20.929 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.929 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.929 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187289 s, 0.0 kB/s 2024-09-17T04:11:20.933 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.934 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.934 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214754 s, 0.0 kB/s 2024-09-17T04:11:20.938 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.938 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.938 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016675 s, 0.0 kB/s 2024-09-17T04:11:20.942 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.942 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.943 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.002075 s, 0.0 kB/s 2024-09-17T04:11:20.947 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.947 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.947 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169217 s, 0.0 kB/s 2024-09-17T04:11:20.951 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.951 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.951 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169717 s, 0.0 kB/s 2024-09-17T04:11:20.955 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.955 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.955 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159733 s, 0.0 kB/s 2024-09-17T04:11:20.959 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.960 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.960 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00210192 s, 0.0 kB/s 2024-09-17T04:11:20.963 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.963 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.964 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162353 s, 0.0 kB/s 2024-09-17T04:11:20.968 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.968 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.968 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176755 s, 0.0 kB/s 2024-09-17T04:11:20.972 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.972 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.972 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166679 s, 0.0 kB/s 2024-09-17T04:11:20.976 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.976 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.976 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183198 s, 0.0 kB/s 2024-09-17T04:11:20.981 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.981 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.981 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191233 s, 0.0 kB/s 2024-09-17T04:11:20.985 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.985 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.985 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183188 s, 0.0 kB/s 2024-09-17T04:11:20.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.989 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.989 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00197509 s, 0.0 kB/s 2024-09-17T04:11:20.993 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.994 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.994 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020934 s, 0.0 kB/s 2024-09-17T04:11:20.998 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:20.998 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:20.998 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019292 s, 0.0 kB/s 2024-09-17T04:11:21.002 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.002 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.002 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175251 s, 0.0 kB/s 2024-09-17T04:11:21.006 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.007 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.007 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204043 s, 0.0 kB/s 2024-09-17T04:11:21.011 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.011 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.011 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199088 s, 0.0 kB/s 2024-09-17T04:11:21.015 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.015 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.016 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168475 s, 0.0 kB/s 2024-09-17T04:11:21.020 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.020 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.020 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195745 s, 0.0 kB/s 2024-09-17T04:11:21.024 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.024 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.024 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194034 s, 0.0 kB/s 2024-09-17T04:11:21.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.029 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201761 s, 0.0 kB/s 2024-09-17T04:11:21.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.033 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199116 s, 0.0 kB/s 2024-09-17T04:11:21.038 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.038 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.038 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00230263 s, 0.0 kB/s 2024-09-17T04:11:21.042 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.043 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.043 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177388 s, 0.0 kB/s 2024-09-17T04:11:21.047 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.047 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.047 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204378 s, 0.0 kB/s 2024-09-17T04:11:21.051 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.051 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.051 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00157486 s, 0.0 kB/s 2024-09-17T04:11:21.055 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.055 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.055 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164092 s, 0.0 kB/s 2024-09-17T04:11:21.059 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.060 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.060 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00215211 s, 0.0 kB/s 2024-09-17T04:11:21.064 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.064 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.064 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198131 s, 0.0 kB/s 2024-09-17T04:11:21.069 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.069 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.069 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00223536 s, 0.0 kB/s 2024-09-17T04:11:21.074 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.074 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.074 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00266512 s, 0.0 kB/s 2024-09-17T04:11:21.079 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.079 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.079 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00216166 s, 0.0 kB/s 2024-09-17T04:11:21.083 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.083 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.083 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206277 s, 0.0 kB/s 2024-09-17T04:11:21.087 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.087 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.088 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181716 s, 0.0 kB/s 2024-09-17T04:11:21.092 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.092 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.092 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189994 s, 0.0 kB/s 2024-09-17T04:11:21.097 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.097 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.097 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195865 s, 0.0 kB/s 2024-09-17T04:11:21.102 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.102 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.102 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171568 s, 0.0 kB/s 2024-09-17T04:11:21.107 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.107 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.107 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00218841 s, 0.0 kB/s 2024-09-17T04:11:21.112 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.112 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.112 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177955 s, 0.0 kB/s 2024-09-17T04:11:21.117 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.117 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.117 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199467 s, 0.0 kB/s 2024-09-17T04:11:21.122 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.122 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.122 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194611 s, 0.0 kB/s 2024-09-17T04:11:21.126 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.127 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.127 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188044 s, 0.0 kB/s 2024-09-17T04:11:21.131 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.131 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.132 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175542 s, 0.0 kB/s 2024-09-17T04:11:21.137 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.137 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.137 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00241439 s, 0.0 kB/s 2024-09-17T04:11:21.141 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.141 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.141 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018506 s, 0.0 kB/s 2024-09-17T04:11:21.147 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.148 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.148 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00288546 s, 0.0 kB/s 2024-09-17T04:11:21.152 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.152 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.153 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193885 s, 0.0 kB/s 2024-09-17T04:11:21.157 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.158 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.158 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187124 s, 0.0 kB/s 2024-09-17T04:11:21.162 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.163 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.163 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00204991 s, 0.0 kB/s 2024-09-17T04:11:21.168 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.168 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.168 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00226113 s, 0.0 kB/s 2024-09-17T04:11:21.173 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.173 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.173 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207111 s, 0.0 kB/s 2024-09-17T04:11:21.177 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.177 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.178 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181133 s, 0.0 kB/s 2024-09-17T04:11:21.182 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.182 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.182 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185574 s, 0.0 kB/s 2024-09-17T04:11:21.187 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.187 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.187 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195314 s, 0.0 kB/s 2024-09-17T04:11:21.191 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.191 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.191 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165997 s, 0.0 kB/s 2024-09-17T04:11:21.196 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.197 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.197 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00242476 s, 0.0 kB/s 2024-09-17T04:11:21.201 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.201 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.201 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193919 s, 0.0 kB/s 2024-09-17T04:11:21.206 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.206 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.206 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.002052 s, 0.0 kB/s 2024-09-17T04:11:21.211 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.211 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.211 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201242 s, 0.0 kB/s 2024-09-17T04:11:21.216 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.216 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.216 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177502 s, 0.0 kB/s 2024-09-17T04:11:21.221 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.221 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.221 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019611 s, 0.0 kB/s 2024-09-17T04:11:21.225 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.226 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.226 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198246 s, 0.0 kB/s 2024-09-17T04:11:21.230 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.230 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.231 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198711 s, 0.0 kB/s 2024-09-17T04:11:21.235 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.236 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.236 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206528 s, 0.0 kB/s 2024-09-17T04:11:21.240 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.241 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.241 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00202944 s, 0.0 kB/s 2024-09-17T04:11:21.245 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.246 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.246 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0020152 s, 0.0 kB/s 2024-09-17T04:11:21.250 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.250 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.251 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00206736 s, 0.0 kB/s 2024-09-17T04:11:21.255 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.255 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.256 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209592 s, 0.0 kB/s 2024-09-17T04:11:21.260 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.261 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.261 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187273 s, 0.0 kB/s 2024-09-17T04:11:21.265 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.266 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.266 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017453 s, 0.0 kB/s 2024-09-17T04:11:21.270 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.270 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.270 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00212691 s, 0.0 kB/s 2024-09-17T04:11:21.275 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.275 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.275 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167914 s, 0.0 kB/s 2024-09-17T04:11:21.280 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.280 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.280 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181277 s, 0.0 kB/s 2024-09-17T04:11:21.284 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.285 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.285 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171925 s, 0.0 kB/s 2024-09-17T04:11:21.289 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.290 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.290 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207953 s, 0.0 kB/s 2024-09-17T04:11:21.294 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.295 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.295 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00198815 s, 0.0 kB/s 2024-09-17T04:11:21.299 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.299 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.299 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171943 s, 0.0 kB/s 2024-09-17T04:11:21.304 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.304 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.304 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186025 s, 0.0 kB/s 2024-09-17T04:11:21.309 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.309 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.309 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00207226 s, 0.0 kB/s 2024-09-17T04:11:21.314 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.314 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.314 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00262135 s, 0.0 kB/s 2024-09-17T04:11:21.319 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.319 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.319 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187543 s, 0.0 kB/s 2024-09-17T04:11:21.323 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.323 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.323 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00174796 s, 0.0 kB/s 2024-09-17T04:11:21.328 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.329 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.329 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018159 s, 0.0 kB/s 2024-09-17T04:11:21.333 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.333 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.333 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193653 s, 0.0 kB/s 2024-09-17T04:11:21.337 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.337 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.337 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176956 s, 0.0 kB/s 2024-09-17T04:11:21.342 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.342 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.342 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166615 s, 0.0 kB/s 2024-09-17T04:11:21.348 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.348 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.348 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00361397 s, 0.0 kB/s 2024-09-17T04:11:21.352 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.352 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.352 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205975 s, 0.0 kB/s 2024-09-17T04:11:21.356 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.357 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.357 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175456 s, 0.0 kB/s 2024-09-17T04:11:21.361 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.361 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.361 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160914 s, 0.0 kB/s 2024-09-17T04:11:21.365 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.365 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.365 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172445 s, 0.0 kB/s 2024-09-17T04:11:21.369 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.369 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.369 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163152 s, 0.0 kB/s 2024-09-17T04:11:21.373 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.374 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.374 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193621 s, 0.0 kB/s 2024-09-17T04:11:21.377 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.378 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.378 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163226 s, 0.0 kB/s 2024-09-17T04:11:21.382 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.382 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.382 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172291 s, 0.0 kB/s 2024-09-17T04:11:21.386 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.386 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.386 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00183578 s, 0.0 kB/s 2024-09-17T04:11:21.391 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.391 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.391 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00211065 s, 0.0 kB/s 2024-09-17T04:11:21.396 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.396 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.396 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201764 s, 0.0 kB/s 2024-09-17T04:11:21.400 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.400 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.400 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171317 s, 0.0 kB/s 2024-09-17T04:11:21.404 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.404 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.404 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169198 s, 0.0 kB/s 2024-09-17T04:11:21.408 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.408 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.408 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170233 s, 0.0 kB/s 2024-09-17T04:11:21.412 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.412 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.412 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162194 s, 0.0 kB/s 2024-09-17T04:11:21.417 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.417 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.417 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171026 s, 0.0 kB/s 2024-09-17T04:11:21.420 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.420 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.421 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178591 s, 0.0 kB/s 2024-09-17T04:11:21.424 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.425 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.425 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170842 s, 0.0 kB/s 2024-09-17T04:11:21.429 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.429 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.429 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176853 s, 0.0 kB/s 2024-09-17T04:11:21.433 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.433 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.433 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017101 s, 0.0 kB/s 2024-09-17T04:11:21.437 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.437 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.437 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182652 s, 0.0 kB/s 2024-09-17T04:11:21.441 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.441 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.441 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00161038 s, 0.0 kB/s 2024-09-17T04:11:21.445 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.445 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.445 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169161 s, 0.0 kB/s 2024-09-17T04:11:21.449 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.449 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.449 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182215 s, 0.0 kB/s 2024-09-17T04:11:21.454 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.454 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.454 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199254 s, 0.0 kB/s 2024-09-17T04:11:21.459 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.460 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0029611 s, 0.0 kB/s 2024-09-17T04:11:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.464 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00205032 s, 0.0 kB/s 2024-09-17T04:11:21.468 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.468 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.468 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165451 s, 0.0 kB/s 2024-09-17T04:11:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.473 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195419 s, 0.0 kB/s 2024-09-17T04:11:21.477 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.477 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.477 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00194914 s, 0.0 kB/s 2024-09-17T04:11:21.482 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.482 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.482 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191354 s, 0.0 kB/s 2024-09-17T04:11:21.486 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.486 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.486 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191818 s, 0.0 kB/s 2024-09-17T04:11:21.490 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.490 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.491 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018428 s, 0.0 kB/s 2024-09-17T04:11:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.495 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171391 s, 0.0 kB/s 2024-09-17T04:11:21.499 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.499 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.499 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187181 s, 0.0 kB/s 2024-09-17T04:11:21.503 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.503 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.504 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188762 s, 0.0 kB/s 2024-09-17T04:11:21.507 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.508 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180547 s, 0.0 kB/s 2024-09-17T04:11:21.512 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.512 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.512 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00218233 s, 0.0 kB/s 2024-09-17T04:11:21.517 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.518 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.518 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00245276 s, 0.0 kB/s 2024-09-17T04:11:21.521 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.522 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.522 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00162704 s, 0.0 kB/s 2024-09-17T04:11:21.526 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.526 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.526 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201241 s, 0.0 kB/s 2024-09-17T04:11:21.530 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.530 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.530 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165992 s, 0.0 kB/s 2024-09-17T04:11:21.534 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.534 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.534 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167431 s, 0.0 kB/s 2024-09-17T04:11:21.538 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.538 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.538 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017334 s, 0.0 kB/s 2024-09-17T04:11:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.542 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.543 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00187112 s, 0.0 kB/s 2024-09-17T04:11:21.547 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.547 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.547 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00214205 s, 0.0 kB/s 2024-09-17T04:11:21.551 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.552 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.552 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180547 s, 0.0 kB/s 2024-09-17T04:11:21.556 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.556 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.556 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00200837 s, 0.0 kB/s 2024-09-17T04:11:21.560 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.560 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.560 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169011 s, 0.0 kB/s 2024-09-17T04:11:21.564 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.564 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.564 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168256 s, 0.0 kB/s 2024-09-17T04:11:21.568 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.568 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.568 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173077 s, 0.0 kB/s 2024-09-17T04:11:21.572 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.573 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.573 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00179368 s, 0.0 kB/s 2024-09-17T04:11:21.576 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.576 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.576 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00154879 s, 0.0 kB/s 2024-09-17T04:11:21.580 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.580 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.581 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167168 s, 0.0 kB/s 2024-09-17T04:11:21.589 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.589 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.589 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00573711 s, 0.0 kB/s 2024-09-17T04:11:21.593 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.593 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.593 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00199641 s, 0.0 kB/s 2024-09-17T04:11:21.597 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.597 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.597 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159353 s, 0.0 kB/s 2024-09-17T04:11:21.601 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.602 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.602 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00189996 s, 0.0 kB/s 2024-09-17T04:11:21.606 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.606 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.606 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00219318 s, 0.0 kB/s 2024-09-17T04:11:21.610 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.610 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.610 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018211 s, 0.0 kB/s 2024-09-17T04:11:21.614 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.615 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.615 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018816 s, 0.0 kB/s 2024-09-17T04:11:21.619 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.619 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.619 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00179633 s, 0.0 kB/s 2024-09-17T04:11:21.623 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.623 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.623 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165279 s, 0.0 kB/s 2024-09-17T04:11:21.628 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.628 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.628 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00209499 s, 0.0 kB/s 2024-09-17T04:11:21.632 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.632 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.632 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00163431 s, 0.0 kB/s 2024-09-17T04:11:21.636 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.636 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.636 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017284 s, 0.0 kB/s 2024-09-17T04:11:21.640 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.640 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.640 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175294 s, 0.0 kB/s 2024-09-17T04:11:21.644 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.644 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.645 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165355 s, 0.0 kB/s 2024-09-17T04:11:21.648 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.648 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.648 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0015175 s, 0.0 kB/s 2024-09-17T04:11:21.652 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.652 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.652 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176115 s, 0.0 kB/s 2024-09-17T04:11:21.656 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.656 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.656 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173153 s, 0.0 kB/s 2024-09-17T04:11:21.660 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.660 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.660 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165848 s, 0.0 kB/s 2024-09-17T04:11:21.665 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.665 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.665 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176577 s, 0.0 kB/s 2024-09-17T04:11:21.669 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.669 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.669 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00175896 s, 0.0 kB/s 2024-09-17T04:11:21.673 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.673 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.673 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00152324 s, 0.0 kB/s 2024-09-17T04:11:21.677 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.677 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.677 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165752 s, 0.0 kB/s 2024-09-17T04:11:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.681 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00158281 s, 0.0 kB/s 2024-09-17T04:11:21.685 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.685 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.685 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164009 s, 0.0 kB/s 2024-09-17T04:11:21.689 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.689 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.689 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016083 s, 0.0 kB/s 2024-09-17T04:11:21.693 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.693 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.693 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185296 s, 0.0 kB/s 2024-09-17T04:11:21.697 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.697 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.697 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155475 s, 0.0 kB/s 2024-09-17T04:11:21.701 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.701 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.701 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00161833 s, 0.0 kB/s 2024-09-17T04:11:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.705 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00158184 s, 0.0 kB/s 2024-09-17T04:11:21.709 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.709 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.709 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160734 s, 0.0 kB/s 2024-09-17T04:11:21.713 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.713 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.713 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185939 s, 0.0 kB/s 2024-09-17T04:11:21.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.720 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.720 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00438724 s, 0.0 kB/s 2024-09-17T04:11:21.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.725 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.725 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167928 s, 0.0 kB/s 2024-09-17T04:11:21.729 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.729 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.729 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018409 s, 0.0 kB/s 2024-09-17T04:11:21.733 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.734 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.734 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201802 s, 0.0 kB/s 2024-09-17T04:11:21.738 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.738 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.738 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176751 s, 0.0 kB/s 2024-09-17T04:11:21.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.742 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.742 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00172972 s, 0.0 kB/s 2024-09-17T04:11:21.746 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.746 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.746 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016049 s, 0.0 kB/s 2024-09-17T04:11:21.750 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.750 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.751 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017096 s, 0.0 kB/s 2024-09-17T04:11:21.755 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.755 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.755 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159041 s, 0.0 kB/s 2024-09-17T04:11:21.759 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.759 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.759 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165187 s, 0.0 kB/s 2024-09-17T04:11:21.763 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.763 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.763 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186622 s, 0.0 kB/s 2024-09-17T04:11:21.767 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.768 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.768 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00186195 s, 0.0 kB/s 2024-09-17T04:11:21.772 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.772 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.772 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0017468 s, 0.0 kB/s 2024-09-17T04:11:21.776 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.776 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.776 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164767 s, 0.0 kB/s 2024-09-17T04:11:21.780 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.780 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.780 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165353 s, 0.0 kB/s 2024-09-17T04:11:21.785 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.785 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.785 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00216161 s, 0.0 kB/s 2024-09-17T04:11:21.790 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.790 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.790 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191521 s, 0.0 kB/s 2024-09-17T04:11:21.794 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.794 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.794 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169331 s, 0.0 kB/s 2024-09-17T04:11:21.798 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.798 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.798 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0016813 s, 0.0 kB/s 2024-09-17T04:11:21.802 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.802 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.802 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00179071 s, 0.0 kB/s 2024-09-17T04:11:21.807 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.807 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.807 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00190636 s, 0.0 kB/s 2024-09-17T04:11:21.811 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.811 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.811 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169466 s, 0.0 kB/s 2024-09-17T04:11:21.815 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.815 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.815 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170703 s, 0.0 kB/s 2024-09-17T04:11:21.819 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.819 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.819 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169975 s, 0.0 kB/s 2024-09-17T04:11:21.823 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.823 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.823 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0018161 s, 0.0 kB/s 2024-09-17T04:11:21.828 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.828 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.828 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00201403 s, 0.0 kB/s 2024-09-17T04:11:21.831 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.832 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.832 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00152275 s, 0.0 kB/s 2024-09-17T04:11:21.835 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.836 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.836 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170276 s, 0.0 kB/s 2024-09-17T04:11:21.840 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.840 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.840 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166083 s, 0.0 kB/s 2024-09-17T04:11:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.844 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.845 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00250998 s, 0.0 kB/s 2024-09-17T04:11:21.849 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.849 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.849 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00177722 s, 0.0 kB/s 2024-09-17T04:11:21.854 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.854 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.854 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00195246 s, 0.0 kB/s 2024-09-17T04:11:21.858 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.858 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.859 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188661 s, 0.0 kB/s 2024-09-17T04:11:21.862 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.863 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.863 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00188481 s, 0.0 kB/s 2024-09-17T04:11:21.866 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.867 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.867 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00165007 s, 0.0 kB/s 2024-09-17T04:11:21.871 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.871 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.871 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00181709 s, 0.0 kB/s 2024-09-17T04:11:21.875 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.875 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.875 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185767 s, 0.0 kB/s 2024-09-17T04:11:21.879 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.879 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.879 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00173927 s, 0.0 kB/s 2024-09-17T04:11:21.883 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.883 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.884 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00166963 s, 0.0 kB/s 2024-09-17T04:11:21.887 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.887 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.888 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168091 s, 0.0 kB/s 2024-09-17T04:11:21.891 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.891 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.892 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156028 s, 0.0 kB/s 2024-09-17T04:11:21.895 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.896 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.896 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00176105 s, 0.0 kB/s 2024-09-17T04:11:21.901 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.901 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.902 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00153764 s, 0.0 kB/s 2024-09-17T04:11:21.903 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.903 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.903 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160628 s, 0.0 kB/s 2024-09-17T04:11:21.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.907 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.907 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155173 s, 0.0 kB/s 2024-09-17T04:11:21.911 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.911 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.911 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168085 s, 0.0 kB/s 2024-09-17T04:11:21.915 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.915 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.915 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156813 s, 0.0 kB/s 2024-09-17T04:11:21.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.920 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.920 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191483 s, 0.0 kB/s 2024-09-17T04:11:21.924 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.924 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.924 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00171139 s, 0.0 kB/s 2024-09-17T04:11:21.928 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.928 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.929 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00182715 s, 0.0 kB/s 2024-09-17T04:11:21.933 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.933 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.933 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00178248 s, 0.0 kB/s 2024-09-17T04:11:21.937 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.937 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.937 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.0019667 s, 0.0 kB/s 2024-09-17T04:11:21.941 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.941 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.941 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167043 s, 0.0 kB/s 2024-09-17T04:11:21.945 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.945 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.946 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.001723 s, 0.0 kB/s 2024-09-17T04:11:21.949 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.950 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.950 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164508 s, 0.0 kB/s 2024-09-17T04:11:21.953 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.954 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.954 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00155856 s, 0.0 kB/s 2024-09-17T04:11:21.957 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.958 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.958 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00164589 s, 0.0 kB/s 2024-09-17T04:11:21.962 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.962 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.962 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170692 s, 0.0 kB/s 2024-09-17T04:11:21.966 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.966 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.966 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00202468 s, 0.0 kB/s 2024-09-17T04:11:21.970 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.970 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.970 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156224 s, 0.0 kB/s 2024-09-17T04:11:21.975 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.975 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.975 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00191074 s, 0.0 kB/s 2024-09-17T04:11:21.979 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.979 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.979 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00160734 s, 0.0 kB/s 2024-09-17T04:11:21.983 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.983 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.983 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185029 s, 0.0 kB/s 2024-09-17T04:11:21.987 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.987 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.988 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00156053 s, 0.0 kB/s 2024-09-17T04:11:21.991 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.991 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.991 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00169365 s, 0.0 kB/s 2024-09-17T04:11:21.995 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:21.995 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:21.995 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00159612 s, 0.0 kB/s 2024-09-17T04:11:22.000 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.000 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.000 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00193153 s, 0.0 kB/s 2024-09-17T04:11:22.004 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.004 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.004 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00185756 s, 0.0 kB/s 2024-09-17T04:11:22.008 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.008 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.008 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00167018 s, 0.0 kB/s 2024-09-17T04:11:22.012 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.012 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.012 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00152635 s, 0.0 kB/s 2024-09-17T04:11:22.016 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.016 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.016 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00158164 s, 0.0 kB/s 2024-09-17T04:11:22.020 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.020 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.021 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00168486 s, 0.0 kB/s 2024-09-17T04:11:22.025 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.025 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.025 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00180579 s, 0.0 kB/s 2024-09-17T04:11:22.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.029 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.029 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00154547 s, 0.0 kB/s 2024-09-17T04:11:22.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.033 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.033 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00170602 s, 0.0 kB/s 2024-09-17T04:11:22.037 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records in 2024-09-17T04:11:22.037 INFO:tasks.workunit.client.0.smithi104.stderr:0+0 records out 2024-09-17T04:11:22.037 INFO:tasks.workunit.client.0.smithi104.stderr:0 bytes copied, 0.00158997 s, 0.0 kB/s 2024-09-17T04:11:22.038 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:22.038 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_dirs 500 2024-09-17T04:11:22.039 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:24.184 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:24.184 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_nodes 500 2024-09-17T04:11:24.184 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:26.263 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:26.263 INFO:tasks.workunit.client.0.smithi104.stderr:+ rename_files 500 2024-09-17T04:11:26.263 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:29.851 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:29.852 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_symlinks 500 2024-09-17T04:11:29.852 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:31.026 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:31.026 INFO:tasks.workunit.client.0.smithi104.stderr:+ make_links 500 2024-09-17T04:11:31.026 INFO:tasks.workunit.client.0.smithi104.stderr:+ set +x 2024-09-17T04:11:32.549 INFO:tasks.workunit.client.0.smithi104.stderr:+ return 0 2024-09-17T04:11:32.549 INFO:tasks.workunit.client.0.smithi104.stderr:+ cleanup 2024-09-17T04:11:32.550 INFO:tasks.workunit.client.0.smithi104.stderr:+ rm -rf link_test_BDwAU7 link_test_cWuuNW link_test_oo5mIB mkdir_test_HMrln4 mkdir_test_QonxSQ mkdir_test_yBZhH3 mkfile_test_N1EKkn mkfile_test_pbVNPu mkfile_test_T4DwFi mknod_test_4EmQq9 mknod_test_FsQveS mknod_test_qL8lSA rename_test_bTqOmD rename_test_h3stmR rename_test_ukVvvi symlink_test_0avvL7 symlink_test_f2gaVs symlink_test_lzRQ5c 2024-09-17T04:11:35.104 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:11:35.108 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:11:41.765 INFO:tasks.workunit.client.0.smithi104.stderr:+ popd 2024-09-17T04:11:41.766 INFO:tasks.workunit.client.0.smithi104.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T04:11:41.766 INFO:tasks.workunit.client.0.smithi104.stdout:OK 2024-09-17T04:11:41.767 INFO:tasks.workunit.client.0.smithi104.stderr:+ echo OK 2024-09-17T04:11:41.767 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T04:11:41.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T04:11:41.801 INFO:tasks.workunit:Stopping ['fs/maxentries'] on client.0... 2024-09-17T04:11:41.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T04:11:42.115 DEBUG:teuthology.parallel:result is None 2024-09-17T04:11:42.115 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:11:42.145 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T04:11:42.145 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T04:11:42.154 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T04:11:42.155 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:11:42.155 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:42.201 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:11:42.202 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:42.258 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:11:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 -- 172.21.15.104:0/173974894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0ccc40 msgr2=0x7f14ec15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 --2- 172.21.15.104:0/173974894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0ccc40 0x7f14ec15ca90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0d1940 tx=0x7f14e802a4b0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 -- 172.21.15.104:0/173974894 shutdown_connections 2024-09-17T04:11:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 --2- 172.21.15.104:0/173974894 >> v2:172.21.15.192:3300/0 conn(0x7f14ec0cd440 0x7f14ec0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 --2- 172.21.15.104:0/173974894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0ccc40 0x7f14ec15ca90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 -- 172.21.15.104:0/173974894 >> 172.21.15.104:0/173974894 conn(0x7f14ec0b46e0 msgr2=0x7f14ec0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:42.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 -- 172.21.15.104:0/173974894 shutdown_connections 2024-09-17T04:11:42.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.411+0000 7f14f4319640 1 -- 172.21.15.104:0/173974894 wait complete. 2024-09-17T04:11:42.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.413+0000 7f14f4319640 1 Processor -- start 2024-09-17T04:11:42.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.413+0000 7f14f4319640 1 -- start start 2024-09-17T04:11:42.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 0x7f14ec1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 0x7f14ec0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec070810 con 0x7f14ec0cd440 2024-09-17T04:11:42.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b6e00 con 0x7f14ec0ccc40 2024-09-17T04:11:42.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f4319640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f14ec070990 con 0x7f14ec0d0bb0 2024-09-17T04:11:42.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32980/0 (socket says 172.21.15.104:32980) 2024-09-17T04:11:42.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 -- 172.21.15.104:0/646574733 learned_addr learned my addr 172.21.15.104:0/646574733 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:42.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f20b5640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 0x7f14ec1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 -- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 msgr2=0x7f14ec0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f28b6640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 0x7f14ec0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 0x7f14ec0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 -- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 msgr2=0x7f14ec1f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 0x7f14ec1f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f18b4640 1 -- 172.21.15.104:0/646574733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec159eb0 con 0x7f14ec0cd440 2024-09-17T04:11:42.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f20b5640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 0x7f14ec1f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.414+0000 7f14f28b6640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 0x7f14ec0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14f18b4640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d6d0 tx=0x7f14dc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc017070 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14dc004310 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec1600d0 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc009a80 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.415+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec15a450 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.416+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ec15ca90 con 0x7f14ec0cd440 2024-09-17T04:11:42.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.416+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14dc009c20 con 0x7f14ec0cd440 2024-09-17T04:11:42.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.417+0000 7f14e2ffd640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 0x7f14d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.417+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f14dc09b1b0 con 0x7f14ec0cd440 2024-09-17T04:11:42.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.417+0000 7f14f20b5640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 0x7f14d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.418+0000 7f14f20b5640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 0x7f14d007b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f14e8033000 tx=0x7f14e8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:42.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.422+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14dc0631f0 con 0x7f14ec0cd440 2024-09-17T04:11:42.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.622+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14ec0b7cc0 con 0x7f14ec0cd440 2024-09-17T04:11:42.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.623+0000 7f14e2ffd640 1 -- 172.21.15.104:0/646574733 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f14dc062af0 con 0x7f14ec0cd440 2024-09-17T04:11:42.623 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 msgr2=0x7f14d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 0x7f14d007b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f14e8033000 tx=0x7f14e8004730 comp rx=0 tx=0).stop 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 msgr2=0x7f14ec14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00d6d0 tx=0x7f14dc00db90 comp rx=0 tx=0).stop 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 shutdown_connections 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f14d0078b90 0x7f14d007b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14ec0d0bb0 0x7f14ec0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14ec0cd440 0x7f14ec14e840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 --2- 172.21.15.104:0/646574733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14ec0ccc40 0x7f14ec1f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 >> 172.21.15.104:0/646574733 conn(0x7f14ec0b46e0 msgr2=0x7f14ec0c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 shutdown_connections 2024-09-17T04:11:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.625+0000 7f14f4319640 1 -- 172.21.15.104:0/646574733 wait complete. 2024-09-17T04:11:42.636 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T04:11:42.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:42.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T04:11:42.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:11:42.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:42.690 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T04:11:42.718 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:11:42.718 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:42.774 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T04:11:42.775 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:42.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:11:42.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.983+0000 7fa7a177b640 1 -- 172.21.15.104:0/1186098832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c06def0 msgr2=0x7fa79c06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.983+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1186098832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c06def0 0x7fa79c06f410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa78c005fd0 tx=0x7fa78c02a8b0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.983+0000 7fa7a177b640 1 -- 172.21.15.104:0/1186098832 shutdown_connections 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.984+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1186098832 >> v2:172.21.15.192:3300/0 conn(0x7fa79c0b5260 0x7fa79c15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.984+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1186098832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c06def0 0x7fa79c06f410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.984+0000 7fa7a177b640 1 -- 172.21.15.104:0/1186098832 >> 172.21.15.104:0/1186098832 conn(0x7fa79c0cdca0 msgr2=0x7fa79c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.984+0000 7fa7a177b640 1 -- 172.21.15.104:0/1186098832 shutdown_connections 2024-09-17T04:11:42.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.984+0000 7fa7a177b640 1 -- 172.21.15.104:0/1186098832 wait complete. 2024-09-17T04:11:42.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.985+0000 7fa7a177b640 1 Processor -- start 2024-09-17T04:11:42.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.986+0000 7fa7a177b640 1 -- start start 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c06def0 0x7fa79c09e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c0b5260 0x7fa79c1f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0b5a00 con 0x7fa79c15bfc0 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0b5880 con 0x7fa79c06def0 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa7a177b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c071300 con 0x7fa79c0b5260 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32982/0 (socket says 172.21.15.104:32982) 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 -- 172.21.15.104:0/1282696165 learned_addr learned my addr 172.21.15.104:0/1282696165 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:42.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79affd640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c06def0 0x7fa79c09e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79a7fc640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c0b5260 0x7fa79c1f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 -- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c0b5260 msgr2=0x7fa79c1f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c0b5260 0x7fa79c1f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 -- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c06def0 msgr2=0x7fa79c09e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c06def0 0x7fa79c09e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 -- 172.21.15.104:0/1282696165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c09ab80 con 0x7fa79c15bfc0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.987+0000 7fa79b7fe640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c390 tx=0x7fa79400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.988+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940052d0 con 0x7fa79c15bfc0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.988+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa794007020 con 0x7fa79c15bfc0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.988+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c147100 con 0x7fa79c15bfc0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.988+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794007470 con 0x7fa79c15bfc0 2024-09-17T04:11:42.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.988+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c09ae20 con 0x7fa79c15bfc0 2024-09-17T04:11:42.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.989+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c06f410 con 0x7fa79c15bfc0 2024-09-17T04:11:42.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.989+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7940067d0 con 0x7fa79c15bfc0 2024-09-17T04:11:42.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.990+0000 7fa7837fe640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 0x7fa78807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:42.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.990+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa79409a440 con 0x7fa79c15bfc0 2024-09-17T04:11:42.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.990+0000 7fa79affd640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 0x7fa78807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:42.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.991+0000 7fa79affd640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 0x7fa78807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa78c034000 tx=0x7fa78c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:42.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:42.995+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa794061ec0 con 0x7fa79c15bfc0 2024-09-17T04:11:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.179+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa79c06da40 con 0x7fa79c15bfc0 2024-09-17T04:11:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.179+0000 7fa7837fe640 1 -- 172.21.15.104:0/1282696165 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fa7940668f0 con 0x7fa79c15bfc0 2024-09-17T04:11:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:11:43.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 msgr2=0x7fa78807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 0x7fa78807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa78c034000 tx=0x7fa78c004ab0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 msgr2=0x7fa79c0d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c390 tx=0x7fa79400c850 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 shutdown_connections 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa788078b90 0x7fa78807b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa79c15bfc0 0x7fa79c0d11b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa79c0b5260 0x7fa79c1f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 --2- 172.21.15.104:0/1282696165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c06def0 0x7fa79c09e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 >> 172.21.15.104:0/1282696165 conn(0x7fa79c0cdca0 msgr2=0x7fa79c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 shutdown_connections 2024-09-17T04:11:43.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.181+0000 7fa7a177b640 1 -- 172.21.15.104:0/1282696165 wait complete. 2024-09-17T04:11:43.192 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T04:11:43.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:43.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.2 2024-09-17T04:11:43.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:11:43.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:43.221 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T04:11:43.276 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:11:43.276 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:43.293 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:11:43.293 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:43.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:11:43.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 -- 172.21.15.104:0/1549387133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd98015fc50 msgr2=0x7fd98006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 --2- 172.21.15.104:0/1549387133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd98015fc50 0x7fd98006ddf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ca680 tx=0x7fd97c02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 -- 172.21.15.104:0/1549387133 shutdown_connections 2024-09-17T04:11:43.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 --2- 172.21.15.104:0/1549387133 >> v2:172.21.15.192:3300/0 conn(0x7fd98006e330 0x7fd9800cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 --2- 172.21.15.104:0/1549387133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd98015fc50 0x7fd98006ddf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 -- 172.21.15.104:0/1549387133 >> 172.21.15.104:0/1549387133 conn(0x7fd9800b1b90 msgr2=0x7fd9800b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:43.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 -- 172.21.15.104:0/1549387133 shutdown_connections 2024-09-17T04:11:43.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.462+0000 7fd9871ad640 1 -- 172.21.15.104:0/1549387133 wait complete. 2024-09-17T04:11:43.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.464+0000 7fd9871ad640 1 Processor -- start 2024-09-17T04:11:43.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.464+0000 7fd9871ad640 1 -- start start 2024-09-17T04:11:43.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd98006e330 0x7fd9801f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd98015fc50 0x7fd9800c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd980070d20 con 0x7fd9800cf7d0 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd980070ba0 con 0x7fd98006e330 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd9871ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800734a0 con 0x7fd98015fc50 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd977fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd977fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33004/0 (socket says 172.21.15.104:33004) 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd977fff640 1 -- 172.21.15.104:0/2795319052 learned_addr learned my addr 172.21.15.104:0/2795319052 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd984f49640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd98006e330 0x7fd9801f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.465+0000 7fd98574a640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd98015fc50 0x7fd9800c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 -- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd98015fc50 msgr2=0x7fd9800c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd98015fc50 0x7fd9800c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 -- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd98006e330 msgr2=0x7fd9801f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd98006e330 0x7fd9801f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 -- 172.21.15.104:0/2795319052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9800c67f0 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd977fff640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd97000d700 tx=0x7fd97000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970017070 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd970009b10 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9800c6ad0 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970010460 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.466+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98015e600 con 0x7fd9800cf7d0 2024-09-17T04:11:43.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.467+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9800c6560 con 0x7fd9800cf7d0 2024-09-17T04:11:43.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.468+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd97001a070 con 0x7fd9800cf7d0 2024-09-17T04:11:43.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.468+0000 7fd9757fa640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 0x7fd96c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:43.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.469+0000 7fd984f49640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 0x7fd96c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:43.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.469+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd97009b150 con 0x7fd9800cf7d0 2024-09-17T04:11:43.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.469+0000 7fd984f49640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 0x7fd96c07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd97c033000 tx=0x7fd97c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.473+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd970062bd0 con 0x7fd9800cf7d0 2024-09-17T04:11:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.665+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9800739c0 con 0x7fd9800cf7d0 2024-09-17T04:11:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.666+0000 7fd9757fa640 1 -- 172.21.15.104:0/2795319052 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fd970067600 con 0x7fd9800cf7d0 2024-09-17T04:11:43.666 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:11:43.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 msgr2=0x7fd96c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 0x7fd96c07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd97c033000 tx=0x7fd97c004730 comp rx=0 tx=0).stop 2024-09-17T04:11:43.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 msgr2=0x7fd9800c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:43.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd97000d700 tx=0x7fd97000dbc0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 shutdown_connections 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd96c078b90 0x7fd96c07b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd98015fc50 0x7fd9800c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9800cf7d0 0x7fd9800c5c50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 --2- 172.21.15.104:0/2795319052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd98006e330 0x7fd9801f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 >> 172.21.15.104:0/2795319052 conn(0x7fd9800b1b90 msgr2=0x7fd9800a0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 shutdown_connections 2024-09-17T04:11:43.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:43.668+0000 7fd9871ad640 1 -- 172.21.15.104:0/2795319052 wait complete. 2024-09-17T04:11:43.679 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T04:11:43.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:43.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T04:11:43.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:11:43.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:43.714 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T04:11:43.841 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:11:43.841 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:43.858 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T04:11:43.858 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:11:43.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:11:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 -- 172.21.15.104:0/1677636500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5100040b0 msgr2=0x7fa510004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 --2- 172.21.15.104:0/1677636500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5100040b0 0x7fa510004800 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa51c001690 tx=0x7fa510005830 comp rx=0 tx=0).stop 2024-09-17T04:11:44.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa527fff640 1 -- 172.21.15.104:0/1677636500 reap_dead start 2024-09-17T04:11:44.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 -- 172.21.15.104:0/1677636500 shutdown_connections 2024-09-17T04:11:44.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 -- 172.21.15.104:0/1677636500 >> 172.21.15.104:0/1677636500 conn(0x7fa5280cdca0 msgr2=0x7fa5280ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:44.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 -- 172.21.15.104:0/1677636500 shutdown_connections 2024-09-17T04:11:44.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.028+0000 7fa52dc15640 1 -- 172.21.15.104:0/1677636500 wait complete. 2024-09-17T04:11:44.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.030+0000 7fa52dc15640 1 Processor -- start 2024-09-17T04:11:44.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.030+0000 7fa52dc15640 1 -- start start 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5100040b0 0x7fa5280d1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5281f5a60 0x7fa5281f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa52815fbb0 con 0x7fa5281460e0 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa52815fa30 con 0x7fa5100040b0 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa52815fd30 con 0x7fa5281f5a60 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33018/0 (socket says 172.21.15.104:33018) 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 -- 172.21.15.104:0/3907154526 learned_addr learned my addr 172.21.15.104:0/3907154526 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa527fff640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5281f5a60 0x7fa5281f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa5277fe640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5100040b0 0x7fa5280d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 -- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5281f5a60 msgr2=0x7fa5281f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5281f5a60 0x7fa5281f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 -- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5100040b0 msgr2=0x7fa5280d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5100040b0 0x7fa5280d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 -- 172.21.15.104:0/3907154526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5281f2540 con 0x7fa5281460e0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa526ffd640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0017b0 tx=0x7fa51c006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c038070 con 0x7fa5281460e0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa51c003af0 con 0x7fa5281460e0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5281f2820 con 0x7fa5281460e0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.032+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c033420 con 0x7fa5281460e0 2024-09-17T04:11:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.033+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281f2de0 con 0x7fa5281460e0 2024-09-17T04:11:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.033+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52806f410 con 0x7fa5281460e0 2024-09-17T04:11:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.034+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa51c030070 con 0x7fa5281460e0 2024-09-17T04:11:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.035+0000 7fa50ffff640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 0x7fa51407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:44.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.035+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fa51c0ba1e0 con 0x7fa5281460e0 2024-09-17T04:11:44.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.035+0000 7fa5277fe640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 0x7fa51407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:44.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.035+0000 7fa5277fe640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 0x7fa51407b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa52815efd0 tx=0x7fa5180067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:44.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.039+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa51c082370 con 0x7fa5281460e0 2024-09-17T04:11:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.223+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa52815cc20 con 0x7fa5281460e0 2024-09-17T04:11:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.223+0000 7fa50ffff640 1 -- 172.21.15.104:0/3907154526 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fa51c081c70 con 0x7fa5281460e0 2024-09-17T04:11:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T04:11:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 msgr2=0x7fa51407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 0x7fa51407b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa52815efd0 tx=0x7fa5180067a0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 msgr2=0x7fa5280d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0017b0 tx=0x7fa51c006360 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 shutdown_connections 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fa514078bc0 0x7fa51407b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5281f5a60 0x7fa5281f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5281460e0 0x7fa5280d17c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 --2- 172.21.15.104:0/3907154526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5100040b0 0x7fa5280d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.225+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 >> 172.21.15.104:0/3907154526 conn(0x7fa5280cdca0 msgr2=0x7fa528071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.226+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 shutdown_connections 2024-09-17T04:11:44.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:44.226+0000 7fa52dc15640 1 -- 172.21.15.104:0/3907154526 wait complete. 2024-09-17T04:11:44.237 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T04:11:44.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.3 2024-09-17T04:11:44.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:11:44.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.267 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T04:11:44.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.323 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:11:44.339 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T04:11:44.339 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:11:44.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T04:11:44.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:11:44.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T04:11:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.570 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T04:11:44.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T04:11:44.654 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-09-17T04:11:44.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:11:44.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.656 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:11:44.674 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T04:11:44.674 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T04:11:44.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T04:11:44.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:11:44.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T04:11:44.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.908 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T04:11:44.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:11:44.923 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T04:11:44.991 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T04:11:44.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:11:44.992 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T04:11:45.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:11:45.004 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 -- 172.21.15.104:0/1443288470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d4073e20 msgr2=0x7f78d4074230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 --2- 172.21.15.104:0/1443288470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d4073e20 0x7f78d4074230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f78c8005fd0 tx=0x7f78c802a670 comp rx=0 tx=0).stop 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 -- 172.21.15.104:0/1443288470 shutdown_connections 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 --2- 172.21.15.104:0/1443288470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d4073e20 0x7f78d4074230 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 -- 172.21.15.104:0/1443288470 >> 172.21.15.104:0/1443288470 conn(0x7f78d40cca40 msgr2=0x7f78d40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 -- 172.21.15.104:0/1443288470 shutdown_connections 2024-09-17T04:11:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.117+0000 7f78d97da640 1 -- 172.21.15.104:0/1443288470 wait complete. 2024-09-17T04:11:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.119+0000 7f78d97da640 1 Processor -- start 2024-09-17T04:11:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.119+0000 7f78d97da640 1 -- start start 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 0x7f78d40c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d40ca610 0x7f78d40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f78d415f4a0 con 0x7f78d415e800 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78d415f320 con 0x7f78d40ca610 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.120+0000 7f78d97da640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f78d415f620 con 0x7f78d4073e20 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33050/0 (socket says 172.21.15.104:33050) 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 -- 172.21.15.104:0/1900956832 learned_addr learned my addr 172.21.15.104:0/1900956832 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d27fc640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d40ca610 0x7f78d40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d2ffd640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 0x7f78d40c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 -- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 msgr2=0x7f78d40c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 0x7f78d40c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 -- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d40ca610 msgr2=0x7f78d40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d40ca610 0x7f78d40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 -- 172.21.15.104:0/1900956832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d40b3ed0 con 0x7f78d415e800 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d2ffd640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 0x7f78d40c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d37fe640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00e9e0 tx=0x7f78cc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc015070 con 0x7f78d415e800 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78cc001ad0 con 0x7f78d415e800 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d40b4350 con 0x7f78d415e800 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc001f20 con 0x7f78d415e800 2024-09-17T04:11:45.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.121+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40b4910 con 0x7f78d415e800 2024-09-17T04:11:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.122+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d40b40a0 con 0x7f78d415e800 2024-09-17T04:11:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.123+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78cc018070 con 0x7f78d415e800 2024-09-17T04:11:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.123+0000 7f78bb7fe640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 0x7f78c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.124+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f78cc09d5e0 con 0x7f78d415e800 2024-09-17T04:11:45.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.124+0000 7f78d2ffd640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 0x7f78c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.124+0000 7f78d2ffd640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 0x7f78c007b0d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78c4007fd0 tx=0x7f78c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.128+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78cc064fe0 con 0x7f78d415e800 2024-09-17T04:11:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.297+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78d40cdb90 con 0x7f78c0078bc0 2024-09-17T04:11:45.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.303+0000 7f78bb7fe640 1 -- 172.21.15.104:0/1900956832 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333274 (secure 0 0 0) 0x7f78d40cdb90 con 0x7f78c0078bc0 2024-09-17T04:11:45.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:11:45.309 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:11:45.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 msgr2=0x7f78c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 0x7f78c007b0d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78c4007fd0 tx=0x7f78c4009040 comp rx=0 tx=0).stop 2024-09-17T04:11:45.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 msgr2=0x7f78d40aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00e9e0 tx=0x7f78cc00eea0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 shutdown_connections 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f78c0078bc0 0x7f78c007b0d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d40ca610 0x7f78d40b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78d415e800 0x7f78d40aef10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 --2- 172.21.15.104:0/1900956832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d4073e20 0x7f78d40c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 >> 172.21.15.104:0/1900956832 conn(0x7f78d40cca40 msgr2=0x7f78d4154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 shutdown_connections 2024-09-17T04:11:45.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.307+0000 7f78d97da640 1 -- 172.21.15.104:0/1900956832 wait complete. 2024-09-17T04:11:45.318 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-17T04:11:43.375913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23755234,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":78,"num_read_kb":261,"num_write":3095,"num_write_kb":26967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5264,"ondisk_log_size":5264,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313988,"kb_used_data":46468,"kb_used_omap":12,"kb_used_meta":267379,"kb_avail":754660732,"statfs":{"total":773094113280,"available":772772589568,"internally_reserved":0,"allocated":47583232,"data_stored":46064274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":273796656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14753353,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":206,"num_write":274,"num_write_kb":14724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002461"},"pg_stats":[{"pgid":"2.1f","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507001+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:11:36.507001+0000","last_peered":"2024-09-17T04:11:36.507001+0000","last_clean":"2024-09-17T04:11:36.507001+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:36.507001+0000","last_undegraded":"2024-09-17T04:11:36.507001+0000","last_fullsized":"2024-09-17T04:11:36.507001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.866063+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:11:37.866063+0000","last_peered":"2024-09-17T04:11:37.866063+0000","last_clean":"2024-09-17T04:11:37.866063+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:37.866063+0000","last_undegraded":"2024-09-17T04:11:37.866063+0000","last_fullsized":"2024-09-17T04:11:37.866063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'29","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.872202+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:11:37.872202+0000","last_peered":"2024-09-17T04:11:37.872202+0000","last_clean":"2024-09-17T04:11:37.872202+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:11:37.872202+0000","last_undegraded":"2024-09-17T04:11:37.872202+0000","last_fullsized":"2024-09-17T04:11:37.872202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'27","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.413761+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:11:38.413761+0000","last_peered":"2024-09-17T04:11:38.413761+0000","last_clean":"2024-09-17T04:11:38.413761+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:38.413761+0000","last_undegraded":"2024-09-17T04:11:38.413761+0000","last_fullsized":"2024-09-17T04:11:38.413761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989007,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'14","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.871620+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:11:37.871620+0000","last_peered":"2024-09-17T04:11:37.871620+0000","last_clean":"2024-09-17T04:11:37.871620+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:37.871620+0000","last_undegraded":"2024-09-17T04:11:37.871620+0000","last_fullsized":"2024-09-17T04:11:37.871620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.807536+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:11:37.807536+0000","last_peered":"2024-09-17T04:11:37.807536+0000","last_clean":"2024-09-17T04:11:37.807536+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:11:37.807536+0000","last_undegraded":"2024-09-17T04:11:37.807536+0000","last_fullsized":"2024-09-17T04:11:37.807536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502598+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:11:36.502598+0000","last_peered":"2024-09-17T04:11:36.502598+0000","last_clean":"2024-09-17T04:11:36.502598+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:36.502598+0000","last_undegraded":"2024-09-17T04:11:36.502598+0000","last_fullsized":"2024-09-17T04:11:36.502598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.865593+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:11:37.865593+0000","last_peered":"2024-09-17T04:11:37.865593+0000","last_clean":"2024-09-17T04:11:37.865593+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:37.865593+0000","last_undegraded":"2024-09-17T04:11:37.865593+0000","last_fullsized":"2024-09-17T04:11:37.865593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'22","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.861612+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:11:37.861612+0000","last_peered":"2024-09-17T04:11:37.861612+0000","last_clean":"2024-09-17T04:11:37.861612+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:11:37.861612+0000","last_undegraded":"2024-09-17T04:11:37.861612+0000","last_fullsized":"2024-09-17T04:11:37.861612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502238+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:11:36.502238+0000","last_peered":"2024-09-17T04:11:36.502238+0000","last_clean":"2024-09-17T04:11:36.502238+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:36.502238+0000","last_undegraded":"2024-09-17T04:11:36.502238+0000","last_fullsized":"2024-09-17T04:11:36.502238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'12","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.872819+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:11:37.872819+0000","last_peered":"2024-09-17T04:11:37.872819+0000","last_clean":"2024-09-17T04:11:37.872819+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:37.872819+0000","last_undegraded":"2024-09-17T04:11:37.872819+0000","last_fullsized":"2024-09-17T04:11:37.872819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'13","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.862684+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:11:37.862684+0000","last_peered":"2024-09-17T04:11:37.862684+0000","last_clean":"2024-09-17T04:11:37.862684+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:11:37.862684+0000","last_undegraded":"2024-09-17T04:11:37.862684+0000","last_fullsized":"2024-09-17T04:11:37.862684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'7","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.849256+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:11:37.849256+0000","last_peered":"2024-09-17T04:11:37.849256+0000","last_clean":"2024-09-17T04:11:37.849256+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:37.849256+0000","last_undegraded":"2024-09-17T04:11:37.849256+0000","last_fullsized":"2024-09-17T04:11:37.849256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'230","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.496576+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:11:36.496576+0000","last_peered":"2024-09-17T04:11:36.496576+0000","last_clean":"2024-09-17T04:11:36.496576+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:36.496576+0000","last_undegraded":"2024-09-17T04:11:36.496576+0000","last_fullsized":"2024-09-17T04:11:36.496576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'15","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.849736+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:11:37.849736+0000","last_peered":"2024-09-17T04:11:37.849736+0000","last_clean":"2024-09-17T04:11:37.849736+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:37.849736+0000","last_undegraded":"2024-09-17T04:11:37.849736+0000","last_fullsized":"2024-09-17T04:11:37.849736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'13","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.858545+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:11:37.858545+0000","last_peered":"2024-09-17T04:11:37.858545+0000","last_clean":"2024-09-17T04:11:37.858545+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:37.858545+0000","last_undegraded":"2024-09-17T04:11:37.858545+0000","last_fullsized":"2024-09-17T04:11:37.858545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500739+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:11:36.500739+0000","last_peered":"2024-09-17T04:11:36.500739+0000","last_clean":"2024-09-17T04:11:36.500739+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:36.500739+0000","last_undegraded":"2024-09-17T04:11:36.500739+0000","last_fullsized":"2024-09-17T04:11:36.500739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'28","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.895659+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:11:37.895659+0000","last_peered":"2024-09-17T04:11:37.895659+0000","last_clean":"2024-09-17T04:11:37.895659+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:37.895659+0000","last_undegraded":"2024-09-17T04:11:37.895659+0000","last_fullsized":"2024-09-17T04:11:37.895659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'12","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.867089+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:11:37.867089+0000","last_peered":"2024-09-17T04:11:37.867089+0000","last_clean":"2024-09-17T04:11:37.867089+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:37.867089+0000","last_undegraded":"2024-09-17T04:11:37.867089+0000","last_fullsized":"2024-09-17T04:11:37.867089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.506434+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:11:36.506434+0000","last_peered":"2024-09-17T04:11:36.506434+0000","last_clean":"2024-09-17T04:11:36.506434+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:36.506434+0000","last_undegraded":"2024-09-17T04:11:36.506434+0000","last_fullsized":"2024-09-17T04:11:36.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.727161+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:11:40.727161+0000","last_peered":"2024-09-17T04:11:40.727161+0000","last_clean":"2024-09-17T04:11:40.727161+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:11:40.727161+0000","last_undegraded":"2024-09-17T04:11:40.727161+0000","last_fullsized":"2024-09-17T04:11:40.727161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'12","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.880506+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:11:37.880506+0000","last_peered":"2024-09-17T04:11:37.880506+0000","last_clean":"2024-09-17T04:11:37.880506+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:37.880506+0000","last_undegraded":"2024-09-17T04:11:37.880506+0000","last_fullsized":"2024-09-17T04:11:37.880506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.514869+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:11:36.514869+0000","last_peered":"2024-09-17T04:11:36.514869+0000","last_clean":"2024-09-17T04:11:36.514869+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:36.514869+0000","last_undegraded":"2024-09-17T04:11:36.514869+0000","last_fullsized":"2024-09-17T04:11:36.514869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'24","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.889950+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:11:37.889950+0000","last_peered":"2024-09-17T04:11:37.889950+0000","last_clean":"2024-09-17T04:11:37.889950+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:37.889950+0000","last_undegraded":"2024-09-17T04:11:37.889950+0000","last_fullsized":"2024-09-17T04:11:37.889950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.872597+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:11:37.872597+0000","last_peered":"2024-09-17T04:11:37.872597+0000","last_clean":"2024-09-17T04:11:37.872597+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:37.872597+0000","last_undegraded":"2024-09-17T04:11:37.872597+0000","last_fullsized":"2024-09-17T04:11:37.872597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.501732+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:11:36.501732+0000","last_peered":"2024-09-17T04:11:36.501732+0000","last_clean":"2024-09-17T04:11:36.501732+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:36.501732+0000","last_undegraded":"2024-09-17T04:11:36.501732+0000","last_fullsized":"2024-09-17T04:11:36.501732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'20","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.892023+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:11:37.892023+0000","last_peered":"2024-09-17T04:11:37.892023+0000","last_clean":"2024-09-17T04:11:37.892023+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:37.892023+0000","last_undegraded":"2024-09-17T04:11:37.892023+0000","last_fullsized":"2024-09-17T04:11:37.892023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'13","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.864020+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:11:37.864020+0000","last_peered":"2024-09-17T04:11:37.864020+0000","last_clean":"2024-09-17T04:11:37.864020+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:37.864020+0000","last_undegraded":"2024-09-17T04:11:37.864020+0000","last_fullsized":"2024-09-17T04:11:37.864020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'49","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.360369+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:11:40.360369+0000","last_peered":"2024-09-17T04:11:40.360369+0000","last_clean":"2024-09-17T04:11:40.360369+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:40.360369+0000","last_undegraded":"2024-09-17T04:11:40.360369+0000","last_fullsized":"2024-09-17T04:11:40.360369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'23","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.895394+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:11:37.895394+0000","last_peered":"2024-09-17T04:11:37.895394+0000","last_clean":"2024-09-17T04:11:37.895394+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:11:37.895394+0000","last_undegraded":"2024-09-17T04:11:37.895394+0000","last_fullsized":"2024-09-17T04:11:37.895394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'28","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.706310+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:11:40.706310+0000","last_peered":"2024-09-17T04:11:40.706310+0000","last_clean":"2024-09-17T04:11:40.706310+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:40.706310+0000","last_undegraded":"2024-09-17T04:11:40.706310+0000","last_fullsized":"2024-09-17T04:11:40.706310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502807+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:11:36.502807+0000","last_peered":"2024-09-17T04:11:36.502807+0000","last_clean":"2024-09-17T04:11:36.502807+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:36.502807+0000","last_undegraded":"2024-09-17T04:11:36.502807+0000","last_fullsized":"2024-09-17T04:11:36.502807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'17","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.887304+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:11:37.887304+0000","last_peered":"2024-09-17T04:11:37.887304+0000","last_clean":"2024-09-17T04:11:37.887304+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:11:37.887304+0000","last_undegraded":"2024-09-17T04:11:37.887304+0000","last_fullsized":"2024-09-17T04:11:37.887304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'12","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.858166+0000","last_change":"2024-09-17T04:10:20.524590+0000","last_active":"2024-09-17T04:11:37.858166+0000","last_peered":"2024-09-17T04:11:37.858166+0000","last_clean":"2024-09-17T04:11:37.858166+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:37.858166+0000","last_undegraded":"2024-09-17T04:11:37.858166+0000","last_fullsized":"2024-09-17T04:11:37.858166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498169+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:11:36.498169+0000","last_peered":"2024-09-17T04:11:36.498169+0000","last_clean":"2024-09-17T04:11:36.498169+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:36.498169+0000","last_undegraded":"2024-09-17T04:11:36.498169+0000","last_fullsized":"2024-09-17T04:11:36.498169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734857+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:11:40.734857+0000","last_peered":"2024-09-17T04:11:40.734857+0000","last_clean":"2024-09-17T04:11:40.734857+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:40.734857+0000","last_undegraded":"2024-09-17T04:11:40.734857+0000","last_fullsized":"2024-09-17T04:11:40.734857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.808993+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:11:37.808993+0000","last_peered":"2024-09-17T04:11:37.808993+0000","last_clean":"2024-09-17T04:11:37.808993+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:37.808993+0000","last_undegraded":"2024-09-17T04:11:37.808993+0000","last_fullsized":"2024-09-17T04:11:37.808993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502159+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:11:36.502159+0000","last_peered":"2024-09-17T04:11:36.502159+0000","last_clean":"2024-09-17T04:11:36.502159+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:36.502159+0000","last_undegraded":"2024-09-17T04:11:36.502159+0000","last_fullsized":"2024-09-17T04:11:36.502159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738012+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:11:40.738012+0000","last_peered":"2024-09-17T04:11:40.738012+0000","last_clean":"2024-09-17T04:11:40.738012+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:11:40.738012+0000","last_undegraded":"2024-09-17T04:11:40.738012+0000","last_fullsized":"2024-09-17T04:11:40.738012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'25","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.499766+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:11:41.499766+0000","last_peered":"2024-09-17T04:11:41.499766+0000","last_clean":"2024-09-17T04:11:41.499766+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:41.499766+0000","last_undegraded":"2024-09-17T04:11:41.499766+0000","last_fullsized":"2024-09-17T04:11:41.499766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'41","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.441348+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:11:38.441348+0000","last_peered":"2024-09-17T04:11:38.441348+0000","last_clean":"2024-09-17T04:11:38.441348+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:38.441348+0000","last_undegraded":"2024-09-17T04:11:38.441348+0000","last_fullsized":"2024-09-17T04:11:38.441348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202869,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":206,"num_write":12,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.720137+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:11:40.720137+0000","last_peered":"2024-09-17T04:11:40.720137+0000","last_clean":"2024-09-17T04:11:40.720137+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:11:40.720137+0000","last_undegraded":"2024-09-17T04:11:40.720137+0000","last_fullsized":"2024-09-17T04:11:40.720137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.887073+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:11:37.887073+0000","last_peered":"2024-09-17T04:11:37.887073+0000","last_clean":"2024-09-17T04:11:37.887073+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:37.887073+0000","last_undegraded":"2024-09-17T04:11:37.887073+0000","last_fullsized":"2024-09-17T04:11:37.887073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'20","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.510181+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:11:36.510181+0000","last_peered":"2024-09-17T04:11:36.510181+0000","last_clean":"2024-09-17T04:11:36.510181+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:36.510181+0000","last_undegraded":"2024-09-17T04:11:36.510181+0000","last_fullsized":"2024-09-17T04:11:36.510181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'18","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.888135+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:11:37.888135+0000","last_peered":"2024-09-17T04:11:37.888135+0000","last_clean":"2024-09-17T04:11:37.888135+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:37.888135+0000","last_undegraded":"2024-09-17T04:11:37.888135+0000","last_fullsized":"2024-09-17T04:11:37.888135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'10","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.838615+0000","last_change":"2024-09-17T04:10:20.524400+0000","last_active":"2024-09-17T04:11:37.838615+0000","last_peered":"2024-09-17T04:11:37.838615+0000","last_clean":"2024-09-17T04:11:37.838615+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:37.838615+0000","last_undegraded":"2024-09-17T04:11:37.838615+0000","last_fullsized":"2024-09-17T04:11:37.838615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.491350+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:11:36.491350+0000","last_peered":"2024-09-17T04:11:36.491350+0000","last_clean":"2024-09-17T04:11:36.491350+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:36.491350+0000","last_undegraded":"2024-09-17T04:11:36.491350+0000","last_fullsized":"2024-09-17T04:11:36.491350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:10:20.773163+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:10:20.773163+0000","last_peered":"2024-09-17T04:10:20.773163+0000","last_clean":"2024-09-17T04:10:20.773163+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:10:20.773163+0000","last_undegraded":"2024-09-17T04:10:20.773163+0000","last_fullsized":"2024-09-17T04:10:20.773163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'17","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.879582+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:11:37.879582+0000","last_peered":"2024-09-17T04:11:37.879582+0000","last_clean":"2024-09-17T04:11:37.879582+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:11:37.879582+0000","last_undegraded":"2024-09-17T04:11:37.879582+0000","last_fullsized":"2024-09-17T04:11:37.879582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.824869+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:11:37.824869+0000","last_peered":"2024-09-17T04:11:37.824869+0000","last_clean":"2024-09-17T04:11:37.824869+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:37.824869+0000","last_undegraded":"2024-09-17T04:11:37.824869+0000","last_fullsized":"2024-09-17T04:11:37.824869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507264+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:11:36.507264+0000","last_peered":"2024-09-17T04:11:36.507264+0000","last_clean":"2024-09-17T04:11:36.507264+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:36.507264+0000","last_undegraded":"2024-09-17T04:11:36.507264+0000","last_fullsized":"2024-09-17T04:11:36.507264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.880552+0000","last_change":"2024-09-17T04:10:20.777190+0000","last_active":"2024-09-17T04:11:37.880552+0000","last_peered":"2024-09-17T04:11:37.880552+0000","last_clean":"2024-09-17T04:11:37.880552+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:11:37.880552+0000","last_undegraded":"2024-09-17T04:11:37.880552+0000","last_fullsized":"2024-09-17T04:11:37.880552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'14","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.892304+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:11:37.892304+0000","last_peered":"2024-09-17T04:11:37.892304+0000","last_clean":"2024-09-17T04:11:37.892304+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:37.892304+0000","last_undegraded":"2024-09-17T04:11:37.892304+0000","last_fullsized":"2024-09-17T04:11:37.892304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.495819+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:11:36.495819+0000","last_peered":"2024-09-17T04:11:36.495819+0000","last_clean":"2024-09-17T04:11:36.495819+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:36.495819+0000","last_undegraded":"2024-09-17T04:11:36.495819+0000","last_fullsized":"2024-09-17T04:11:36.495819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'29","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.879668+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:11:37.879668+0000","last_peered":"2024-09-17T04:11:37.879668+0000","last_clean":"2024-09-17T04:11:37.879668+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:11:37.879668+0000","last_undegraded":"2024-09-17T04:11:37.879668+0000","last_fullsized":"2024-09-17T04:11:37.879668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.811404+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:11:37.811404+0000","last_peered":"2024-09-17T04:11:37.811404+0000","last_clean":"2024-09-17T04:11:37.811404+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:37.811404+0000","last_undegraded":"2024-09-17T04:11:37.811404+0000","last_fullsized":"2024-09-17T04:11:37.811404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500631+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:11:36.500631+0000","last_peered":"2024-09-17T04:11:36.500631+0000","last_clean":"2024-09-17T04:11:36.500631+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:36.500631+0000","last_undegraded":"2024-09-17T04:11:36.500631+0000","last_fullsized":"2024-09-17T04:11:36.500631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'25","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.887684+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:11:37.887684+0000","last_peered":"2024-09-17T04:11:37.887684+0000","last_clean":"2024-09-17T04:11:37.887684+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:11:37.887684+0000","last_undegraded":"2024-09-17T04:11:37.887684+0000","last_fullsized":"2024-09-17T04:11:37.887684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'7","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.807519+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:11:37.807519+0000","last_peered":"2024-09-17T04:11:37.807519+0000","last_clean":"2024-09-17T04:11:37.807519+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:11:37.807519+0000","last_undegraded":"2024-09-17T04:11:37.807519+0000","last_fullsized":"2024-09-17T04:11:37.807519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498143+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:11:36.498143+0000","last_peered":"2024-09-17T04:11:36.498143+0000","last_clean":"2024-09-17T04:11:36.498143+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:36.498143+0000","last_undegraded":"2024-09-17T04:11:36.498143+0000","last_fullsized":"2024-09-17T04:11:36.498143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'22","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.890492+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:11:37.890492+0000","last_peered":"2024-09-17T04:11:37.890492+0000","last_clean":"2024-09-17T04:11:37.890492+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:37.890492+0000","last_undegraded":"2024-09-17T04:11:37.890492+0000","last_fullsized":"2024-09-17T04:11:37.890492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.765027+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:11:37.765027+0000","last_peered":"2024-09-17T04:11:37.765027+0000","last_clean":"2024-09-17T04:11:37.765027+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:11:37.765027+0000","last_undegraded":"2024-09-17T04:11:37.765027+0000","last_fullsized":"2024-09-17T04:11:37.765027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'30","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.489475+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:11:36.489475+0000","last_peered":"2024-09-17T04:11:36.489475+0000","last_clean":"2024-09-17T04:11:36.489475+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:36.489475+0000","last_undegraded":"2024-09-17T04:11:36.489475+0000","last_fullsized":"2024-09-17T04:11:36.489475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'24","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.839224+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:11:37.839224+0000","last_peered":"2024-09-17T04:11:37.839224+0000","last_clean":"2024-09-17T04:11:37.839224+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:11:37.839224+0000","last_undegraded":"2024-09-17T04:11:37.839224+0000","last_fullsized":"2024-09-17T04:11:37.839224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.828131+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:11:37.828131+0000","last_peered":"2024-09-17T04:11:37.828131+0000","last_clean":"2024-09-17T04:11:37.828131+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:37.828131+0000","last_undegraded":"2024-09-17T04:11:37.828131+0000","last_fullsized":"2024-09-17T04:11:37.828131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'28","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.509590+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:11:36.509590+0000","last_peered":"2024-09-17T04:11:36.509590+0000","last_clean":"2024-09-17T04:11:36.509590+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:36.509590+0000","last_undegraded":"2024-09-17T04:11:36.509590+0000","last_fullsized":"2024-09-17T04:11:36.509590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.857922+0000","last_change":"2024-09-17T04:10:20.775487+0000","last_active":"2024-09-17T04:11:37.857922+0000","last_peered":"2024-09-17T04:11:37.857922+0000","last_clean":"2024-09-17T04:11:37.857922+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:11:37.857922+0000","last_undegraded":"2024-09-17T04:11:37.857922+0000","last_fullsized":"2024-09-17T04:11:37.857922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:23.072496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'14","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.869969+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:11:37.869969+0000","last_peered":"2024-09-17T04:11:37.869969+0000","last_clean":"2024-09-17T04:11:37.869969+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:11:37.869969+0000","last_undegraded":"2024-09-17T04:11:37.869969+0000","last_fullsized":"2024-09-17T04:11:37.869969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'33","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.505555+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:11:36.505555+0000","last_peered":"2024-09-17T04:11:36.505555+0000","last_clean":"2024-09-17T04:11:36.505555+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:36.505555+0000","last_undegraded":"2024-09-17T04:11:36.505555+0000","last_fullsized":"2024-09-17T04:11:36.505555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.868885+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:11:37.868885+0000","last_peered":"2024-09-17T04:11:37.868885+0000","last_clean":"2024-09-17T04:11:37.868885+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:11:37.868885+0000","last_undegraded":"2024-09-17T04:11:37.868885+0000","last_fullsized":"2024-09-17T04:11:37.868885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.864198+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:11:37.864198+0000","last_peered":"2024-09-17T04:11:37.864198+0000","last_clean":"2024-09-17T04:11:37.864198+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:37.864198+0000","last_undegraded":"2024-09-17T04:11:37.864198+0000","last_fullsized":"2024-09-17T04:11:37.864198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.497713+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:11:36.497713+0000","last_peered":"2024-09-17T04:11:36.497713+0000","last_clean":"2024-09-17T04:11:36.497713+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:36.497713+0000","last_undegraded":"2024-09-17T04:11:36.497713+0000","last_fullsized":"2024-09-17T04:11:36.497713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'18","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.888202+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:11:37.888202+0000","last_peered":"2024-09-17T04:11:37.888202+0000","last_clean":"2024-09-17T04:11:37.888202+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:11:37.888202+0000","last_undegraded":"2024-09-17T04:11:37.888202+0000","last_fullsized":"2024-09-17T04:11:37.888202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.882116+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:11:37.882116+0000","last_peered":"2024-09-17T04:11:37.882116+0000","last_clean":"2024-09-17T04:11:37.882116+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:11:37.882116+0000","last_undegraded":"2024-09-17T04:11:37.882116+0000","last_fullsized":"2024-09-17T04:11:37.882116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1189","reported_seq":1216,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.511528+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:11:36.511528+0000","last_peered":"2024-09-17T04:11:36.511528+0000","last_clean":"2024-09-17T04:11:36.511528+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:36.511528+0000","last_undegraded":"2024-09-17T04:11:36.511528+0000","last_fullsized":"2024-09-17T04:11:36.511528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.715571+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:11:40.715571+0000","last_peered":"2024-09-17T04:11:40.715571+0000","last_clean":"2024-09-17T04:11:40.715571+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:11:40.715571+0000","last_undegraded":"2024-09-17T04:11:40.715571+0000","last_fullsized":"2024-09-17T04:11:40.715571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.866036+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:11:37.866036+0000","last_peered":"2024-09-17T04:11:37.866036+0000","last_clean":"2024-09-17T04:11:37.866036+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:37.866036+0000","last_undegraded":"2024-09-17T04:11:37.866036+0000","last_fullsized":"2024-09-17T04:11:37.866036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.939447+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:11:39.939447+0000","last_peered":"2024-09-17T04:11:39.939447+0000","last_clean":"2024-09-17T04:11:39.939447+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:39.939447+0000","last_undegraded":"2024-09-17T04:11:39.939447+0000","last_fullsized":"2024-09-17T04:11:39.939447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'23","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.872010+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:11:37.872010+0000","last_peered":"2024-09-17T04:11:37.872010+0000","last_clean":"2024-09-17T04:11:37.872010+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:11:37.872010+0000","last_undegraded":"2024-09-17T04:11:37.872010+0000","last_fullsized":"2024-09-17T04:11:37.872010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.849620+0000","last_change":"2024-09-17T04:10:20.772111+0000","last_active":"2024-09-17T04:11:37.849620+0000","last_peered":"2024-09-17T04:11:37.849620+0000","last_clean":"2024-09-17T04:11:37.849620+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:37.849620+0000","last_undegraded":"2024-09-17T04:11:37.849620+0000","last_fullsized":"2024-09-17T04:11:37.849620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.090846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502785+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:11:36.502785+0000","last_peered":"2024-09-17T04:11:36.502785+0000","last_clean":"2024-09-17T04:11:36.502785+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:36.502785+0000","last_undegraded":"2024-09-17T04:11:36.502785+0000","last_fullsized":"2024-09-17T04:11:36.502785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'19","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.873104+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:11:37.873104+0000","last_peered":"2024-09-17T04:11:37.873104+0000","last_clean":"2024-09-17T04:11:37.873104+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:11:37.873104+0000","last_undegraded":"2024-09-17T04:11:37.873104+0000","last_fullsized":"2024-09-17T04:11:37.873104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'13","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.825522+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:11:37.825522+0000","last_peered":"2024-09-17T04:11:37.825522+0000","last_clean":"2024-09-17T04:11:37.825522+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:37.825522+0000","last_undegraded":"2024-09-17T04:11:37.825522+0000","last_fullsized":"2024-09-17T04:11:37.825522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'22","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.501641+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:11:36.501641+0000","last_peered":"2024-09-17T04:11:36.501641+0000","last_clean":"2024-09-17T04:11:36.501641+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:36.501641+0000","last_undegraded":"2024-09-17T04:11:36.501641+0000","last_fullsized":"2024-09-17T04:11:36.501641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'18","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.871489+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:11:37.871489+0000","last_peered":"2024-09-17T04:11:37.871489+0000","last_clean":"2024-09-17T04:11:37.871489+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:11:37.871489+0000","last_undegraded":"2024-09-17T04:11:37.871489+0000","last_fullsized":"2024-09-17T04:11:37.871489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'20","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.876418+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:11:37.876418+0000","last_peered":"2024-09-17T04:11:37.876418+0000","last_clean":"2024-09-17T04:11:37.876418+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:11:37.876418+0000","last_undegraded":"2024-09-17T04:11:37.876418+0000","last_fullsized":"2024-09-17T04:11:37.876418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.709809+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:11:40.709809+0000","last_peered":"2024-09-17T04:11:40.709809+0000","last_clean":"2024-09-17T04:11:40.709809+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:11:40.709809+0000","last_undegraded":"2024-09-17T04:11:40.709809+0000","last_fullsized":"2024-09-17T04:11:40.709809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.483640+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:11:36.483640+0000","last_peered":"2024-09-17T04:11:36.483640+0000","last_clean":"2024-09-17T04:11:36.483640+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:36.483640+0000","last_undegraded":"2024-09-17T04:11:36.483640+0000","last_fullsized":"2024-09-17T04:11:36.483640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'25","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.890205+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:11:37.890205+0000","last_peered":"2024-09-17T04:11:37.890205+0000","last_clean":"2024-09-17T04:11:37.890205+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:11:37.890205+0000","last_undegraded":"2024-09-17T04:11:37.890205+0000","last_fullsized":"2024-09-17T04:11:37.890205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'7","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.800206+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:11:37.800206+0000","last_peered":"2024-09-17T04:11:37.800206+0000","last_clean":"2024-09-17T04:11:37.800206+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:37.800206+0000","last_undegraded":"2024-09-17T04:11:37.800206+0000","last_fullsized":"2024-09-17T04:11:37.800206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500242+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:11:36.500242+0000","last_peered":"2024-09-17T04:11:36.500242+0000","last_clean":"2024-09-17T04:11:36.500242+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:36.500242+0000","last_undegraded":"2024-09-17T04:11:36.500242+0000","last_fullsized":"2024-09-17T04:11:36.500242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'28","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.220875+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:11:37.220875+0000","last_peered":"2024-09-17T04:11:37.220875+0000","last_clean":"2024-09-17T04:11:37.220875+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:37.220875+0000","last_undegraded":"2024-09-17T04:11:37.220875+0000","last_fullsized":"2024-09-17T04:11:37.220875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'13","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.861294+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:11:37.861294+0000","last_peered":"2024-09-17T04:11:37.861294+0000","last_clean":"2024-09-17T04:11:37.861294+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:37.861294+0000","last_undegraded":"2024-09-17T04:11:37.861294+0000","last_fullsized":"2024-09-17T04:11:37.861294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'15","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.880777+0000","last_change":"2024-09-17T04:10:20.525430+0000","last_active":"2024-09-17T04:11:37.880777+0000","last_peered":"2024-09-17T04:11:37.880777+0000","last_clean":"2024-09-17T04:11:37.880777+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:37.880777+0000","last_undegraded":"2024-09-17T04:11:37.880777+0000","last_fullsized":"2024-09-17T04:11:37.880777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:25.125740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1527,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.512367+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:11:36.512367+0000","last_peered":"2024-09-17T04:11:36.512367+0000","last_clean":"2024-09-17T04:11:36.512367+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:36.512367+0000","last_undegraded":"2024-09-17T04:11:36.512367+0000","last_fullsized":"2024-09-17T04:11:36.512367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.858301+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:11:37.858301+0000","last_peered":"2024-09-17T04:11:37.858301+0000","last_clean":"2024-09-17T04:11:37.858301+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:37.858301+0000","last_undegraded":"2024-09-17T04:11:37.858301+0000","last_fullsized":"2024-09-17T04:11:37.858301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'23","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.869202+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:11:37.869202+0000","last_peered":"2024-09-17T04:11:37.869202+0000","last_clean":"2024-09-17T04:11:37.869202+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:11:37.869202+0000","last_undegraded":"2024-09-17T04:11:37.869202+0000","last_fullsized":"2024-09-17T04:11:37.869202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'14","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.849356+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:11:37.849356+0000","last_peered":"2024-09-17T04:11:37.849356+0000","last_clean":"2024-09-17T04:11:37.849356+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:37.849356+0000","last_undegraded":"2024-09-17T04:11:37.849356+0000","last_fullsized":"2024-09-17T04:11:37.849356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.876759+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:11:37.876759+0000","last_peered":"2024-09-17T04:11:37.876759+0000","last_clean":"2024-09-17T04:11:37.876759+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:37.876759+0000","last_undegraded":"2024-09-17T04:11:37.876759+0000","last_fullsized":"2024-09-17T04:11:37.876759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'15","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.886837+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:11:37.886837+0000","last_peered":"2024-09-17T04:11:37.886837+0000","last_clean":"2024-09-17T04:11:37.886837+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:11:37.886837+0000","last_undegraded":"2024-09-17T04:11:37.886837+0000","last_fullsized":"2024-09-17T04:11:37.886837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.884643+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:11:37.884643+0000","last_peered":"2024-09-17T04:11:37.884643+0000","last_clean":"2024-09-17T04:11:37.884643+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:37.884643+0000","last_undegraded":"2024-09-17T04:11:37.884643+0000","last_fullsized":"2024-09-17T04:11:37.884643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.835839+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:11:37.835839+0000","last_peered":"2024-09-17T04:11:37.835839+0000","last_clean":"2024-09-17T04:11:37.835839+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:37.835839+0000","last_undegraded":"2024-09-17T04:11:37.835839+0000","last_fullsized":"2024-09-17T04:11:37.835839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'24","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742444+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:11:40.742444+0000","last_peered":"2024-09-17T04:11:40.742444+0000","last_clean":"2024-09-17T04:11:40.742444+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:40.742444+0000","last_undegraded":"2024-09-17T04:11:40.742444+0000","last_fullsized":"2024-09-17T04:11:40.742444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'11","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.879156+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:11:37.879156+0000","last_peered":"2024-09-17T04:11:37.879156+0000","last_clean":"2024-09-17T04:11:37.879156+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:37.879156+0000","last_undegraded":"2024-09-17T04:11:37.879156+0000","last_fullsized":"2024-09-17T04:11:37.879156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'15","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.878780+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:11:37.878780+0000","last_peered":"2024-09-17T04:11:37.878780+0000","last_clean":"2024-09-17T04:11:37.878780+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:37.878780+0000","last_undegraded":"2024-09-17T04:11:37.878780+0000","last_fullsized":"2024-09-17T04:11:37.878780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'13","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.885213+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:11:37.885213+0000","last_peered":"2024-09-17T04:11:37.885213+0000","last_clean":"2024-09-17T04:11:37.885213+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:37.885213+0000","last_undegraded":"2024-09-17T04:11:37.885213+0000","last_fullsized":"2024-09-17T04:11:37.885213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.869706+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:11:37.869706+0000","last_peered":"2024-09-17T04:11:37.869706+0000","last_clean":"2024-09-17T04:11:37.869706+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:11:37.869706+0000","last_undegraded":"2024-09-17T04:11:37.869706+0000","last_fullsized":"2024-09-17T04:11:37.869706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.843578+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:11:37.843578+0000","last_peered":"2024-09-17T04:11:37.843578+0000","last_clean":"2024-09-17T04:11:37.843578+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:11:37.843578+0000","last_undegraded":"2024-09-17T04:11:37.843578+0000","last_fullsized":"2024-09-17T04:11:37.843578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'16","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.874882+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:11:37.874882+0000","last_peered":"2024-09-17T04:11:37.874882+0000","last_clean":"2024-09-17T04:11:37.874882+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:11:37.874882+0000","last_undegraded":"2024-09-17T04:11:37.874882+0000","last_fullsized":"2024-09-17T04:11:37.874882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'14","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.838924+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:11:37.838924+0000","last_peered":"2024-09-17T04:11:37.838924+0000","last_clean":"2024-09-17T04:11:37.838924+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:11:37.838924+0000","last_undegraded":"2024-09-17T04:11:37.838924+0000","last_fullsized":"2024-09-17T04:11:37.838924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.838765+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:11:37.838765+0000","last_peered":"2024-09-17T04:11:37.838765+0000","last_clean":"2024-09-17T04:11:37.838765+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:11:37.838765+0000","last_undegraded":"2024-09-17T04:11:37.838765+0000","last_fullsized":"2024-09-17T04:11:37.838765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'17","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.885675+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:11:37.885675+0000","last_peered":"2024-09-17T04:11:37.885675+0000","last_clean":"2024-09-17T04:11:37.885675+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:37.885675+0000","last_undegraded":"2024-09-17T04:11:37.885675+0000","last_fullsized":"2024-09-17T04:11:37.885675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'7","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.767734+0000","last_change":"2024-09-17T04:10:20.775054+0000","last_active":"2024-09-17T04:11:37.767734+0000","last_peered":"2024-09-17T04:11:37.767734+0000","last_clean":"2024-09-17T04:11:37.767734+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:37.767734+0000","last_undegraded":"2024-09-17T04:11:37.767734+0000","last_fullsized":"2024-09-17T04:11:37.767734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'11","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.837946+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:11:37.837946+0000","last_peered":"2024-09-17T04:11:37.837946+0000","last_clean":"2024-09-17T04:11:37.837946+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:11:37.837946+0000","last_undegraded":"2024-09-17T04:11:37.837946+0000","last_fullsized":"2024-09-17T04:11:37.837946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.712704+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:11:40.712704+0000","last_peered":"2024-09-17T04:11:40.712704+0000","last_clean":"2024-09-17T04:11:40.712704+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:40.712704+0000","last_undegraded":"2024-09-17T04:11:40.712704+0000","last_fullsized":"2024-09-17T04:11:40.712704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.860898+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:11:37.860898+0000","last_peered":"2024-09-17T04:11:37.860898+0000","last_clean":"2024-09-17T04:11:37.860898+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:37.860898+0000","last_undegraded":"2024-09-17T04:11:37.860898+0000","last_fullsized":"2024-09-17T04:11:37.860898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.846816+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:11:37.846816+0000","last_peered":"2024-09-17T04:11:37.846816+0000","last_clean":"2024-09-17T04:11:37.846816+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:11:37.846816+0000","last_undegraded":"2024-09-17T04:11:37.846816+0000","last_fullsized":"2024-09-17T04:11:37.846816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.822217+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:11:37.822217+0000","last_peered":"2024-09-17T04:11:37.822217+0000","last_clean":"2024-09-17T04:11:37.822217+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:37.822217+0000","last_undegraded":"2024-09-17T04:11:37.822217+0000","last_fullsized":"2024-09-17T04:11:37.822217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.879709+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:11:37.879709+0000","last_peered":"2024-09-17T04:11:37.879709+0000","last_clean":"2024-09-17T04:11:37.879709+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:11:37.879709+0000","last_undegraded":"2024-09-17T04:11:37.879709+0000","last_fullsized":"2024-09-17T04:11:37.879709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'11","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.839069+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:11:37.839069+0000","last_peered":"2024-09-17T04:11:37.839069+0000","last_clean":"2024-09-17T04:11:37.839069+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:11:37.839069+0000","last_undegraded":"2024-09-17T04:11:37.839069+0000","last_fullsized":"2024-09-17T04:11:37.839069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'8","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.841597+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:11:37.841597+0000","last_peered":"2024-09-17T04:11:37.841597+0000","last_clean":"2024-09-17T04:11:37.841597+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:11:37.841597+0000","last_undegraded":"2024-09-17T04:11:37.841597+0000","last_fullsized":"2024-09-17T04:11:37.841597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.793863+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:11:37.793863+0000","last_peered":"2024-09-17T04:11:37.793863+0000","last_clean":"2024-09-17T04:11:37.793863+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:11:37.793863+0000","last_undegraded":"2024-09-17T04:11:37.793863+0000","last_fullsized":"2024-09-17T04:11:37.793863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'15","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.872919+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:11:37.872919+0000","last_peered":"2024-09-17T04:11:37.872919+0000","last_clean":"2024-09-17T04:11:37.872919+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:11:37.872919+0000","last_undegraded":"2024-09-17T04:11:37.872919+0000","last_fullsized":"2024-09-17T04:11:37.872919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.798654+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:11:37.798654+0000","last_peered":"2024-09-17T04:11:37.798654+0000","last_clean":"2024-09-17T04:11:37.798654+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:11:37.798654+0000","last_undegraded":"2024-09-17T04:11:37.798654+0000","last_fullsized":"2024-09-17T04:11:37.798654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'9","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.793759+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:11:37.793759+0000","last_peered":"2024-09-17T04:11:37.793759+0000","last_clean":"2024-09-17T04:11:37.793759+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:11:37.793759+0000","last_undegraded":"2024-09-17T04:11:37.793759+0000","last_fullsized":"2024-09-17T04:11:37.793759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'7","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.829033+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:11:37.829033+0000","last_peered":"2024-09-17T04:11:37.829033+0000","last_clean":"2024-09-17T04:11:37.829033+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:11:37.829033+0000","last_undegraded":"2024-09-17T04:11:37.829033+0000","last_fullsized":"2024-09-17T04:11:37.829033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'11","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.798177+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:11:37.798177+0000","last_peered":"2024-09-17T04:11:37.798177+0000","last_clean":"2024-09-17T04:11:37.798177+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:37.798177+0000","last_undegraded":"2024-09-17T04:11:37.798177+0000","last_fullsized":"2024-09-17T04:11:37.798177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.651303+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:11:40.651303+0000","last_peered":"2024-09-17T04:11:40.651303+0000","last_clean":"2024-09-17T04:11:40.651303+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:40.651303+0000","last_undegraded":"2024-09-17T04:11:40.651303+0000","last_fullsized":"2024-09-17T04:11:40.651303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'11","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.846925+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:11:37.846925+0000","last_peered":"2024-09-17T04:11:37.846925+0000","last_clean":"2024-09-17T04:11:37.846925+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:11:37.846925+0000","last_undegraded":"2024-09-17T04:11:37.846925+0000","last_fullsized":"2024-09-17T04:11:37.846925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":754,"ondisk_log_size":754,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23164866,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":12,"num_read_kb":206,"num_write":2994,"num_write_kb":25339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46391296,"data_stored":46329732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3671,"ondisk_log_size":3671,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48516,"kb_used_data":13172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323324,"statfs":{"total":96636764160,"available":96587083776,"internally_reserved":0,"allocated":13488128,"data_stored":13299322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39684,"kb_used_data":8500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332156,"statfs":{"total":96636764160,"available":96596127744,"internally_reserved":0,"allocated":8704000,"data_stored":8514740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67804,"kb_used_data":10252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304036,"statfs":{"total":96636764160,"available":96567332864,"internally_reserved":0,"allocated":10498048,"data_stored":10306066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":268012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":4988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":5107712,"data_stored":4910770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6197248,"data_stored":6183949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":202869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10592256,"data_stored":10581156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8389280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:11:45.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 -- 172.21.15.104:0/2310378759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2240b2e60 msgr2=0x7fd2240b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2310378759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2240b2e60 0x7fd2240b3270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd21c005fd0 tx=0x7fd21c02aa90 comp rx=0 tx=0).stop 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 -- 172.21.15.104:0/2310378759 shutdown_connections 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2310378759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2240b2e60 0x7fd2240b3270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2310378759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240cfe00 0x7fd2240d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 -- 172.21.15.104:0/2310378759 >> 172.21.15.104:0/2310378759 conn(0x7fd2240d4440 msgr2=0x7fd2240d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 -- 172.21.15.104:0/2310378759 shutdown_connections 2024-09-17T04:11:45.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.470+0000 7fd2292d3640 1 -- 172.21.15.104:0/2310378759 wait complete. 2024-09-17T04:11:45.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.472+0000 7fd2292d3640 1 Processor -- start 2024-09-17T04:11:45.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.472+0000 7fd2292d3640 1 -- start start 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240b2e60 0x7fd224154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2240cfe00 0x7fd2241579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240b3930 con 0x7fd224162590 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240b37b0 con 0x7fd2240cfe00 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2292d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240b3ab0 con 0x7fd2240b2e60 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33070/0 (socket says 172.21.15.104:33070) 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2237fe640 1 -- 172.21.15.104:0/2261566768 learned_addr learned my addr 172.21.15.104:0/2261566768 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:45.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd222ffd640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240b2e60 0x7fd224154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2227fc640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2240cfe00 0x7fd2241579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2237fe640 1 -- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240b2e60 msgr2=0x7fd224154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.473+0000 7fd2237fe640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240b2e60 0x7fd224154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2237fe640 1 -- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2240cfe00 msgr2=0x7fd2241579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2237fe640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2240cfe00 0x7fd2241579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2237fe640 1 -- 172.21.15.104:0/2261566768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241535a0 con 0x7fd224162590 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2237fe640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009bf0 tx=0x7fd21c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c044070 con 0x7fd224162590 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd21c004250 con 0x7fd224162590 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd224153880 con 0x7fd224162590 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004660 con 0x7fd224162590 2024-09-17T04:11:45.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.474+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd224153e40 con 0x7fd224162590 2024-09-17T04:11:45.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.475+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2240b3270 con 0x7fd224162590 2024-09-17T04:11:45.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.476+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd21c047070 con 0x7fd224162590 2024-09-17T04:11:45.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.476+0000 7fd20b7fe640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 0x7fd21007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.476+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd21c0bc060 con 0x7fd224162590 2024-09-17T04:11:45.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.476+0000 7fd222ffd640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 0x7fd21007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.477+0000 7fd222ffd640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 0x7fd21007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd214004630 tx=0x7fd21400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.481+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd21c032030 con 0x7fd224162590 2024-09-17T04:11:45.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.653+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2240d4a40 con 0x7fd210078bc0 2024-09-17T04:11:45.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.659+0000 7fd20b7fe640 1 -- 172.21.15.104:0/2261566768 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333389 (secure 0 0 0) 0x7fd2240d4a40 con 0x7fd210078bc0 2024-09-17T04:11:45.663 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:11:45.665 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.662+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 msgr2=0x7fd21007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.662+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 0x7fd21007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd214004630 tx=0x7fd21400b2e0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 msgr2=0x7fd224157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009bf0 tx=0x7fd21c003ce0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 shutdown_connections 2024-09-17T04:11:45.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd210078bc0 0x7fd21007b0d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2240cfe00 0x7fd2241579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd224162590 0x7fd224157f30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 --2- 172.21.15.104:0/2261566768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2240b2e60 0x7fd224154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 >> 172.21.15.104:0/2261566768 conn(0x7fd2240d4440 msgr2=0x7fd22406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 shutdown_connections 2024-09-17T04:11:45.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.663+0000 7fd2292d3640 1 -- 172.21.15.104:0/2261566768 wait complete. 2024-09-17T04:11:45.674 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-17T04:11:45.376318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31472628,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":93,"num_read_kb":434,"num_write":3143,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8410,"ondisk_log_size":8410,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347980,"kb_used_data":63820,"kb_used_omap":12,"kb_used_meta":284019,"kb_avail":754626740,"statfs":{"total":773094113280,"available":772737781760,"internally_reserved":0,"allocated":65351680,"data_stored":63828971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":290836016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,5,15,1,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22470747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":312,"num_write_kb":22258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002592"},"pg_stats":[{"pgid":"2.1f","version":"29'26","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507130+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:11:36.507130+0000","last_peered":"2024-09-17T04:11:36.507130+0000","last_clean":"2024-09-17T04:11:36.507130+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:36.507130+0000","last_undegraded":"2024-09-17T04:11:36.507130+0000","last_fullsized":"2024-09-17T04:11:36.507130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'46","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716562+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:11:42.716562+0000","last_peered":"2024-09-17T04:11:42.716562+0000","last_clean":"2024-09-17T04:11:42.716562+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:42.716562+0000","last_undegraded":"2024-09-17T04:11:42.716562+0000","last_fullsized":"2024-09-17T04:11:42.716562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.735676+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:11:40.735676+0000","last_peered":"2024-09-17T04:11:40.735676+0000","last_clean":"2024-09-17T04:11:40.735676+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:11:40.735676+0000","last_undegraded":"2024-09-17T04:11:40.735676+0000","last_fullsized":"2024-09-17T04:11:40.735676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'32","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.062024+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:11:39.062024+0000","last_peered":"2024-09-17T04:11:39.062024+0000","last_clean":"2024-09-17T04:11:39.062024+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:39.062024+0000","last_undegraded":"2024-09-17T04:11:39.062024+0000","last_fullsized":"2024-09-17T04:11:39.062024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'57","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.711752+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:11:42.711752+0000","last_peered":"2024-09-17T04:11:42.711752+0000","last_clean":"2024-09-17T04:11:42.711752+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:42.711752+0000","last_undegraded":"2024-09-17T04:11:42.711752+0000","last_fullsized":"2024-09-17T04:11:42.711752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.580956+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:11:41.580956+0000","last_peered":"2024-09-17T04:11:41.580956+0000","last_clean":"2024-09-17T04:11:41.580956+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:11:41.580956+0000","last_undegraded":"2024-09-17T04:11:41.580956+0000","last_fullsized":"2024-09-17T04:11:41.580956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'56","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.730702+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:11:42.730702+0000","last_peered":"2024-09-17T04:11:42.730702+0000","last_clean":"2024-09-17T04:11:42.730702+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:42.730702+0000","last_undegraded":"2024-09-17T04:11:42.730702+0000","last_fullsized":"2024-09-17T04:11:42.730702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5346473,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712715+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:11:42.712715+0000","last_peered":"2024-09-17T04:11:42.712715+0000","last_clean":"2024-09-17T04:11:42.712715+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:42.712715+0000","last_undegraded":"2024-09-17T04:11:42.712715+0000","last_fullsized":"2024-09-17T04:11:42.712715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'44","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579980+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:11:41.579980+0000","last_peered":"2024-09-17T04:11:41.579980+0000","last_clean":"2024-09-17T04:11:41.579980+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:11:41.579980+0000","last_undegraded":"2024-09-17T04:11:41.579980+0000","last_fullsized":"2024-09-17T04:11:41.579980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502238+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:11:36.502238+0000","last_peered":"2024-09-17T04:11:36.502238+0000","last_clean":"2024-09-17T04:11:36.502238+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:36.502238+0000","last_undegraded":"2024-09-17T04:11:36.502238+0000","last_fullsized":"2024-09-17T04:11:36.502238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712664+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:11:42.712664+0000","last_peered":"2024-09-17T04:11:42.712664+0000","last_clean":"2024-09-17T04:11:42.712664+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:42.712664+0000","last_undegraded":"2024-09-17T04:11:42.712664+0000","last_fullsized":"2024-09-17T04:11:42.712664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.750069+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:11:40.750069+0000","last_peered":"2024-09-17T04:11:40.750069+0000","last_clean":"2024-09-17T04:11:40.750069+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:11:40.750069+0000","last_undegraded":"2024-09-17T04:11:40.750069+0000","last_fullsized":"2024-09-17T04:11:40.750069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.711710+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:11:42.711710+0000","last_peered":"2024-09-17T04:11:42.711710+0000","last_clean":"2024-09-17T04:11:42.711710+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:42.711710+0000","last_undegraded":"2024-09-17T04:11:42.711710+0000","last_fullsized":"2024-09-17T04:11:42.711710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'230","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.496576+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:11:36.496576+0000","last_peered":"2024-09-17T04:11:36.496576+0000","last_clean":"2024-09-17T04:11:36.496576+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:36.496576+0000","last_undegraded":"2024-09-17T04:11:36.496576+0000","last_fullsized":"2024-09-17T04:11:36.496576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'41","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.748495+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:11:40.748495+0000","last_peered":"2024-09-17T04:11:40.748495+0000","last_clean":"2024-09-17T04:11:40.748495+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:40.748495+0000","last_undegraded":"2024-09-17T04:11:40.748495+0000","last_fullsized":"2024-09-17T04:11:40.748495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720958+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:11:42.720958+0000","last_peered":"2024-09-17T04:11:42.720958+0000","last_clean":"2024-09-17T04:11:42.720958+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:42.720958+0000","last_undegraded":"2024-09-17T04:11:42.720958+0000","last_fullsized":"2024-09-17T04:11:42.720958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500739+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:11:36.500739+0000","last_peered":"2024-09-17T04:11:36.500739+0000","last_clean":"2024-09-17T04:11:36.500739+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:36.500739+0000","last_undegraded":"2024-09-17T04:11:36.500739+0000","last_fullsized":"2024-09-17T04:11:36.500739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'48","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577284+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:11:41.577284+0000","last_peered":"2024-09-17T04:11:41.577284+0000","last_clean":"2024-09-17T04:11:41.577284+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:41.577284+0000","last_undegraded":"2024-09-17T04:11:41.577284+0000","last_fullsized":"2024-09-17T04:11:41.577284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714637+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:11:42.714637+0000","last_peered":"2024-09-17T04:11:42.714637+0000","last_clean":"2024-09-17T04:11:42.714637+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:42.714637+0000","last_undegraded":"2024-09-17T04:11:42.714637+0000","last_fullsized":"2024-09-17T04:11:42.714637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.506434+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:11:36.506434+0000","last_peered":"2024-09-17T04:11:36.506434+0000","last_clean":"2024-09-17T04:11:36.506434+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:36.506434+0000","last_undegraded":"2024-09-17T04:11:36.506434+0000","last_fullsized":"2024-09-17T04:11:36.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.727161+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:11:40.727161+0000","last_peered":"2024-09-17T04:11:40.727161+0000","last_clean":"2024-09-17T04:11:40.727161+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:11:40.727161+0000","last_undegraded":"2024-09-17T04:11:40.727161+0000","last_fullsized":"2024-09-17T04:11:40.727161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487545+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:11:43.487545+0000","last_peered":"2024-09-17T04:11:43.487545+0000","last_clean":"2024-09-17T04:11:43.487545+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:43.487545+0000","last_undegraded":"2024-09-17T04:11:43.487545+0000","last_fullsized":"2024-09-17T04:11:43.487545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.514869+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:11:36.514869+0000","last_peered":"2024-09-17T04:11:36.514869+0000","last_clean":"2024-09-17T04:11:36.514869+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:36.514869+0000","last_undegraded":"2024-09-17T04:11:36.514869+0000","last_fullsized":"2024-09-17T04:11:36.514869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738221+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:11:40.738221+0000","last_peered":"2024-09-17T04:11:40.738221+0000","last_clean":"2024-09-17T04:11:40.738221+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:40.738221+0000","last_undegraded":"2024-09-17T04:11:40.738221+0000","last_fullsized":"2024-09-17T04:11:40.738221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.488400+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:11:43.488400+0000","last_peered":"2024-09-17T04:11:43.488400+0000","last_clean":"2024-09-17T04:11:43.488400+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:43.488400+0000","last_undegraded":"2024-09-17T04:11:43.488400+0000","last_fullsized":"2024-09-17T04:11:43.488400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.490748+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:11:42.490748+0000","last_peered":"2024-09-17T04:11:42.490748+0000","last_clean":"2024-09-17T04:11:42.490748+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:42.490748+0000","last_undegraded":"2024-09-17T04:11:42.490748+0000","last_fullsized":"2024-09-17T04:11:42.490748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'46","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728163+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:11:40.728163+0000","last_peered":"2024-09-17T04:11:40.728163+0000","last_clean":"2024-09-17T04:11:40.728163+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:40.728163+0000","last_undegraded":"2024-09-17T04:11:40.728163+0000","last_fullsized":"2024-09-17T04:11:40.728163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715413+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:11:42.715413+0000","last_peered":"2024-09-17T04:11:42.715413+0000","last_clean":"2024-09-17T04:11:42.715413+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:42.715413+0000","last_undegraded":"2024-09-17T04:11:42.715413+0000","last_fullsized":"2024-09-17T04:11:42.715413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'49","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.360369+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:11:40.360369+0000","last_peered":"2024-09-17T04:11:40.360369+0000","last_clean":"2024-09-17T04:11:40.360369+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:40.360369+0000","last_undegraded":"2024-09-17T04:11:40.360369+0000","last_fullsized":"2024-09-17T04:11:40.360369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'51","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579480+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:11:41.579480+0000","last_peered":"2024-09-17T04:11:41.579480+0000","last_clean":"2024-09-17T04:11:41.579480+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:11:41.579480+0000","last_undegraded":"2024-09-17T04:11:41.579480+0000","last_fullsized":"2024-09-17T04:11:41.579480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'28","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.706310+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:11:40.706310+0000","last_peered":"2024-09-17T04:11:40.706310+0000","last_clean":"2024-09-17T04:11:40.706310+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:40.706310+0000","last_undegraded":"2024-09-17T04:11:40.706310+0000","last_fullsized":"2024-09-17T04:11:40.706310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.508913+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:11:36.508913+0000","last_peered":"2024-09-17T04:11:36.508913+0000","last_clean":"2024-09-17T04:11:36.508913+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:36.508913+0000","last_undegraded":"2024-09-17T04:11:36.508913+0000","last_fullsized":"2024-09-17T04:11:36.508913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.729414+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:11:40.729414+0000","last_peered":"2024-09-17T04:11:40.729414+0000","last_clean":"2024-09-17T04:11:40.729414+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:11:40.729414+0000","last_undegraded":"2024-09-17T04:11:40.729414+0000","last_fullsized":"2024-09-17T04:11:40.729414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'46","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487146+0000","last_change":"2024-09-17T04:10:20.524590+0000","last_active":"2024-09-17T04:11:43.487146+0000","last_peered":"2024-09-17T04:11:43.487146+0000","last_clean":"2024-09-17T04:11:43.487146+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:43.487146+0000","last_undegraded":"2024-09-17T04:11:43.487146+0000","last_fullsized":"2024-09-17T04:11:43.487146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498169+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:11:36.498169+0000","last_peered":"2024-09-17T04:11:36.498169+0000","last_clean":"2024-09-17T04:11:36.498169+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:36.498169+0000","last_undegraded":"2024-09-17T04:11:36.498169+0000","last_fullsized":"2024-09-17T04:11:36.498169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734857+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:11:40.734857+0000","last_peered":"2024-09-17T04:11:40.734857+0000","last_clean":"2024-09-17T04:11:40.734857+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:40.734857+0000","last_undegraded":"2024-09-17T04:11:40.734857+0000","last_fullsized":"2024-09-17T04:11:40.734857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.703167+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:11:42.703167+0000","last_peered":"2024-09-17T04:11:42.703167+0000","last_clean":"2024-09-17T04:11:42.703167+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:42.703167+0000","last_undegraded":"2024-09-17T04:11:42.703167+0000","last_fullsized":"2024-09-17T04:11:42.703167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'24","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.505881+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:11:42.505881+0000","last_peered":"2024-09-17T04:11:42.505881+0000","last_clean":"2024-09-17T04:11:42.505881+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:42.505881+0000","last_undegraded":"2024-09-17T04:11:42.505881+0000","last_fullsized":"2024-09-17T04:11:42.505881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738012+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:11:40.738012+0000","last_peered":"2024-09-17T04:11:40.738012+0000","last_clean":"2024-09-17T04:11:40.738012+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:11:40.738012+0000","last_undegraded":"2024-09-17T04:11:40.738012+0000","last_fullsized":"2024-09-17T04:11:40.738012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'25","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.499766+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:11:41.499766+0000","last_peered":"2024-09-17T04:11:41.499766+0000","last_clean":"2024-09-17T04:11:41.499766+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:41.499766+0000","last_undegraded":"2024-09-17T04:11:41.499766+0000","last_fullsized":"2024-09-17T04:11:41.499766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'56","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.480749+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:11:43.480749+0000","last_peered":"2024-09-17T04:11:43.480749+0000","last_clean":"2024-09-17T04:11:43.480749+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:43.480749+0000","last_undegraded":"2024-09-17T04:11:43.480749+0000","last_fullsized":"2024-09-17T04:11:43.480749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":27,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.720137+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:11:40.720137+0000","last_peered":"2024-09-17T04:11:40.720137+0000","last_clean":"2024-09-17T04:11:40.720137+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:11:40.720137+0000","last_undegraded":"2024-09-17T04:11:40.720137+0000","last_fullsized":"2024-09-17T04:11:40.720137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716682+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:11:42.716682+0000","last_peered":"2024-09-17T04:11:42.716682+0000","last_clean":"2024-09-17T04:11:42.716682+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:42.716682+0000","last_undegraded":"2024-09-17T04:11:42.716682+0000","last_fullsized":"2024-09-17T04:11:42.716682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'21","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.512580+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:11:38.512580+0000","last_peered":"2024-09-17T04:11:38.512580+0000","last_clean":"2024-09-17T04:11:38.512580+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:38.512580+0000","last_undegraded":"2024-09-17T04:11:38.512580+0000","last_fullsized":"2024-09-17T04:11:38.512580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734313+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:11:40.734313+0000","last_peered":"2024-09-17T04:11:40.734313+0000","last_clean":"2024-09-17T04:11:40.734313+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:40.734313+0000","last_undegraded":"2024-09-17T04:11:40.734313+0000","last_fullsized":"2024-09-17T04:11:40.734313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'57","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.709660+0000","last_change":"2024-09-17T04:10:20.524400+0000","last_active":"2024-09-17T04:11:42.709660+0000","last_peered":"2024-09-17T04:11:42.709660+0000","last_clean":"2024-09-17T04:11:42.709660+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:42.709660+0000","last_undegraded":"2024-09-17T04:11:42.709660+0000","last_fullsized":"2024-09-17T04:11:42.709660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'20","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.553052+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:11:40.553052+0000","last_peered":"2024-09-17T04:11:40.553052+0000","last_clean":"2024-09-17T04:11:40.553052+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:40.553052+0000","last_undegraded":"2024-09-17T04:11:40.553052+0000","last_fullsized":"2024-09-17T04:11:40.553052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:10:20.773163+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:10:20.773163+0000","last_peered":"2024-09-17T04:10:20.773163+0000","last_clean":"2024-09-17T04:10:20.773163+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:10:20.773163+0000","last_undegraded":"2024-09-17T04:10:20.773163+0000","last_fullsized":"2024-09-17T04:10:20.773163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'35","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.744925+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:11:40.744925+0000","last_peered":"2024-09-17T04:11:40.744925+0000","last_clean":"2024-09-17T04:11:40.744925+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:11:40.744925+0000","last_undegraded":"2024-09-17T04:11:40.744925+0000","last_fullsized":"2024-09-17T04:11:40.744925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726744+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:11:42.726744+0000","last_peered":"2024-09-17T04:11:42.726744+0000","last_clean":"2024-09-17T04:11:42.726744+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:42.726744+0000","last_undegraded":"2024-09-17T04:11:42.726744+0000","last_fullsized":"2024-09-17T04:11:42.726744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507264+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:11:36.507264+0000","last_peered":"2024-09-17T04:11:36.507264+0000","last_clean":"2024-09-17T04:11:36.507264+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:36.507264+0000","last_undegraded":"2024-09-17T04:11:36.507264+0000","last_fullsized":"2024-09-17T04:11:36.507264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'34","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747834+0000","last_change":"2024-09-17T04:10:20.777190+0000","last_active":"2024-09-17T04:11:40.747834+0000","last_peered":"2024-09-17T04:11:40.747834+0000","last_clean":"2024-09-17T04:11:40.747834+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:11:40.747834+0000","last_undegraded":"2024-09-17T04:11:40.747834+0000","last_fullsized":"2024-09-17T04:11:40.747834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704033+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:11:42.704033+0000","last_peered":"2024-09-17T04:11:42.704033+0000","last_clean":"2024-09-17T04:11:42.704033+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:42.704033+0000","last_undegraded":"2024-09-17T04:11:42.704033+0000","last_fullsized":"2024-09-17T04:11:42.704033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.495819+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:11:36.495819+0000","last_peered":"2024-09-17T04:11:36.495819+0000","last_clean":"2024-09-17T04:11:36.495819+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:36.495819+0000","last_undegraded":"2024-09-17T04:11:36.495819+0000","last_fullsized":"2024-09-17T04:11:36.495819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577119+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:11:41.577119+0000","last_peered":"2024-09-17T04:11:41.577119+0000","last_clean":"2024-09-17T04:11:41.577119+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:11:41.577119+0000","last_undegraded":"2024-09-17T04:11:41.577119+0000","last_fullsized":"2024-09-17T04:11:41.577119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728585+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:11:42.728585+0000","last_peered":"2024-09-17T04:11:42.728585+0000","last_clean":"2024-09-17T04:11:42.728585+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:42.728585+0000","last_undegraded":"2024-09-17T04:11:42.728585+0000","last_fullsized":"2024-09-17T04:11:42.728585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.509070+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:11:36.509070+0000","last_peered":"2024-09-17T04:11:36.509070+0000","last_clean":"2024-09-17T04:11:36.509070+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:36.509070+0000","last_undegraded":"2024-09-17T04:11:36.509070+0000","last_fullsized":"2024-09-17T04:11:36.509070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'50","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.576524+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:11:41.576524+0000","last_peered":"2024-09-17T04:11:41.576524+0000","last_clean":"2024-09-17T04:11:41.576524+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:11:41.576524+0000","last_undegraded":"2024-09-17T04:11:41.576524+0000","last_fullsized":"2024-09-17T04:11:41.576524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726118+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:11:42.726118+0000","last_peered":"2024-09-17T04:11:42.726118+0000","last_clean":"2024-09-17T04:11:42.726118+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:11:42.726118+0000","last_undegraded":"2024-09-17T04:11:42.726118+0000","last_fullsized":"2024-09-17T04:11:42.726118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498143+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:11:36.498143+0000","last_peered":"2024-09-17T04:11:36.498143+0000","last_clean":"2024-09-17T04:11:36.498143+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:36.498143+0000","last_undegraded":"2024-09-17T04:11:36.498143+0000","last_fullsized":"2024-09-17T04:11:36.498143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'47","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734413+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:11:40.734413+0000","last_peered":"2024-09-17T04:11:40.734413+0000","last_clean":"2024-09-17T04:11:40.734413+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:40.734413+0000","last_undegraded":"2024-09-17T04:11:40.734413+0000","last_fullsized":"2024-09-17T04:11:40.734413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.724540+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:11:42.724540+0000","last_peered":"2024-09-17T04:11:42.724540+0000","last_clean":"2024-09-17T04:11:42.724540+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:11:42.724540+0000","last_undegraded":"2024-09-17T04:11:42.724540+0000","last_fullsized":"2024-09-17T04:11:42.724540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'33","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486531+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:11:43.486531+0000","last_peered":"2024-09-17T04:11:43.486531+0000","last_clean":"2024-09-17T04:11:43.486531+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:43.486531+0000","last_undegraded":"2024-09-17T04:11:43.486531+0000","last_fullsized":"2024-09-17T04:11:43.486531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'54","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.708373+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:11:40.708373+0000","last_peered":"2024-09-17T04:11:40.708373+0000","last_clean":"2024-09-17T04:11:40.708373+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:11:40.708373+0000","last_undegraded":"2024-09-17T04:11:40.708373+0000","last_fullsized":"2024-09-17T04:11:40.708373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.702217+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:11:42.702217+0000","last_peered":"2024-09-17T04:11:42.702217+0000","last_clean":"2024-09-17T04:11:42.702217+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:42.702217+0000","last_undegraded":"2024-09-17T04:11:42.702217+0000","last_fullsized":"2024-09-17T04:11:42.702217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'30","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.862284+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:11:39.862284+0000","last_peered":"2024-09-17T04:11:39.862284+0000","last_clean":"2024-09-17T04:11:39.862284+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:39.862284+0000","last_undegraded":"2024-09-17T04:11:39.862284+0000","last_fullsized":"2024-09-17T04:11:39.862284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'43","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.739540+0000","last_change":"2024-09-17T04:10:20.775487+0000","last_active":"2024-09-17T04:11:40.739540+0000","last_peered":"2024-09-17T04:11:40.739540+0000","last_clean":"2024-09-17T04:11:40.739540+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:11:40.739540+0000","last_undegraded":"2024-09-17T04:11:40.739540+0000","last_fullsized":"2024-09-17T04:11:40.739540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:23.072496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729353+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:11:42.729353+0000","last_peered":"2024-09-17T04:11:42.729353+0000","last_clean":"2024-09-17T04:11:42.729353+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:11:42.729353+0000","last_undegraded":"2024-09-17T04:11:42.729353+0000","last_fullsized":"2024-09-17T04:11:42.729353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'35","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.672344+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:11:38.672344+0000","last_peered":"2024-09-17T04:11:38.672344+0000","last_clean":"2024-09-17T04:11:38.672344+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:38.672344+0000","last_undegraded":"2024-09-17T04:11:38.672344+0000","last_fullsized":"2024-09-17T04:11:38.672344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'34","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.714640+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:11:40.714640+0000","last_peered":"2024-09-17T04:11:40.714640+0000","last_clean":"2024-09-17T04:11:40.714640+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:11:40.714640+0000","last_undegraded":"2024-09-17T04:11:40.714640+0000","last_fullsized":"2024-09-17T04:11:40.714640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487153+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:11:43.487153+0000","last_peered":"2024-09-17T04:11:43.487153+0000","last_clean":"2024-09-17T04:11:43.487153+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:43.487153+0000","last_undegraded":"2024-09-17T04:11:43.487153+0000","last_fullsized":"2024-09-17T04:11:43.487153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'17","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.511219+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:11:36.511219+0000","last_peered":"2024-09-17T04:11:36.511219+0000","last_clean":"2024-09-17T04:11:36.511219+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:36.511219+0000","last_undegraded":"2024-09-17T04:11:36.511219+0000","last_fullsized":"2024-09-17T04:11:36.511219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'38","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.578153+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:11:41.578153+0000","last_peered":"2024-09-17T04:11:41.578153+0000","last_clean":"2024-09-17T04:11:41.578153+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:11:41.578153+0000","last_undegraded":"2024-09-17T04:11:41.578153+0000","last_fullsized":"2024-09-17T04:11:41.578153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726285+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:11:42.726285+0000","last_peered":"2024-09-17T04:11:42.726285+0000","last_clean":"2024-09-17T04:11:42.726285+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:11:42.726285+0000","last_undegraded":"2024-09-17T04:11:42.726285+0000","last_fullsized":"2024-09-17T04:11:42.726285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1191","reported_seq":1218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.685750+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:11:38.685750+0000","last_peered":"2024-09-17T04:11:38.685750+0000","last_clean":"2024-09-17T04:11:38.685750+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:38.685750+0000","last_undegraded":"2024-09-17T04:11:38.685750+0000","last_fullsized":"2024-09-17T04:11:38.685750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":5144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.715571+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:11:40.715571+0000","last_peered":"2024-09-17T04:11:40.715571+0000","last_clean":"2024-09-17T04:11:40.715571+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:11:40.715571+0000","last_undegraded":"2024-09-17T04:11:40.715571+0000","last_fullsized":"2024-09-17T04:11:40.715571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715263+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:11:42.715263+0000","last_peered":"2024-09-17T04:11:42.715263+0000","last_clean":"2024-09-17T04:11:42.715263+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:42.715263+0000","last_undegraded":"2024-09-17T04:11:42.715263+0000","last_fullsized":"2024-09-17T04:11:42.715263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.939447+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:11:39.939447+0000","last_peered":"2024-09-17T04:11:39.939447+0000","last_clean":"2024-09-17T04:11:39.939447+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:39.939447+0000","last_undegraded":"2024-09-17T04:11:39.939447+0000","last_fullsized":"2024-09-17T04:11:39.939447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728486+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:11:40.728486+0000","last_peered":"2024-09-17T04:11:40.728486+0000","last_clean":"2024-09-17T04:11:40.728486+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:11:40.728486+0000","last_undegraded":"2024-09-17T04:11:40.728486+0000","last_fullsized":"2024-09-17T04:11:40.728486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714395+0000","last_change":"2024-09-17T04:10:20.772111+0000","last_active":"2024-09-17T04:11:42.714395+0000","last_peered":"2024-09-17T04:11:42.714395+0000","last_clean":"2024-09-17T04:11:42.714395+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:42.714395+0000","last_undegraded":"2024-09-17T04:11:42.714395+0000","last_fullsized":"2024-09-17T04:11:42.714395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.090846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.503007+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:11:36.503007+0000","last_peered":"2024-09-17T04:11:36.503007+0000","last_clean":"2024-09-17T04:11:36.503007+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:36.503007+0000","last_undegraded":"2024-09-17T04:11:36.503007+0000","last_fullsized":"2024-09-17T04:11:36.503007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.724578+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:11:40.724578+0000","last_peered":"2024-09-17T04:11:40.724578+0000","last_clean":"2024-09-17T04:11:40.724578+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:11:40.724578+0000","last_undegraded":"2024-09-17T04:11:40.724578+0000","last_fullsized":"2024-09-17T04:11:40.724578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'73","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486351+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:11:43.486351+0000","last_peered":"2024-09-17T04:11:43.486351+0000","last_clean":"2024-09-17T04:11:43.486351+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:43.486351+0000","last_undegraded":"2024-09-17T04:11:43.486351+0000","last_fullsized":"2024-09-17T04:11:43.486351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.501810+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:11:36.501810+0000","last_peered":"2024-09-17T04:11:36.501810+0000","last_clean":"2024-09-17T04:11:36.501810+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:36.501810+0000","last_undegraded":"2024-09-17T04:11:36.501810+0000","last_fullsized":"2024-09-17T04:11:36.501810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747723+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:11:40.747723+0000","last_peered":"2024-09-17T04:11:40.747723+0000","last_clean":"2024-09-17T04:11:40.747723+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:11:40.747723+0000","last_undegraded":"2024-09-17T04:11:40.747723+0000","last_fullsized":"2024-09-17T04:11:40.747723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'43","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.582824+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:11:41.582824+0000","last_peered":"2024-09-17T04:11:41.582824+0000","last_clean":"2024-09-17T04:11:41.582824+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:11:41.582824+0000","last_undegraded":"2024-09-17T04:11:41.582824+0000","last_fullsized":"2024-09-17T04:11:41.582824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.709809+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:11:40.709809+0000","last_peered":"2024-09-17T04:11:40.709809+0000","last_clean":"2024-09-17T04:11:40.709809+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:11:40.709809+0000","last_undegraded":"2024-09-17T04:11:40.709809+0000","last_fullsized":"2024-09-17T04:11:40.709809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.483640+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:11:36.483640+0000","last_peered":"2024-09-17T04:11:36.483640+0000","last_clean":"2024-09-17T04:11:36.483640+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:36.483640+0000","last_undegraded":"2024-09-17T04:11:36.483640+0000","last_fullsized":"2024-09-17T04:11:36.483640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'50","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728936+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:11:40.728936+0000","last_peered":"2024-09-17T04:11:40.728936+0000","last_clean":"2024-09-17T04:11:40.728936+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:11:40.728936+0000","last_undegraded":"2024-09-17T04:11:40.728936+0000","last_fullsized":"2024-09-17T04:11:40.728936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'65","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720993+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:11:42.720993+0000","last_peered":"2024-09-17T04:11:42.720993+0000","last_clean":"2024-09-17T04:11:42.720993+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:42.720993+0000","last_undegraded":"2024-09-17T04:11:42.720993+0000","last_fullsized":"2024-09-17T04:11:42.720993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500242+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:11:36.500242+0000","last_peered":"2024-09-17T04:11:36.500242+0000","last_clean":"2024-09-17T04:11:36.500242+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:36.500242+0000","last_undegraded":"2024-09-17T04:11:36.500242+0000","last_fullsized":"2024-09-17T04:11:36.500242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.400201+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:11:37.400201+0000","last_peered":"2024-09-17T04:11:37.400201+0000","last_clean":"2024-09-17T04:11:37.400201+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:37.400201+0000","last_undegraded":"2024-09-17T04:11:37.400201+0000","last_fullsized":"2024-09-17T04:11:37.400201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719121+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:11:42.719121+0000","last_peered":"2024-09-17T04:11:42.719121+0000","last_clean":"2024-09-17T04:11:42.719121+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:42.719121+0000","last_undegraded":"2024-09-17T04:11:42.719121+0000","last_fullsized":"2024-09-17T04:11:42.719121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747899+0000","last_change":"2024-09-17T04:10:20.525430+0000","last_active":"2024-09-17T04:11:40.747899+0000","last_peered":"2024-09-17T04:11:40.747899+0000","last_clean":"2024-09-17T04:11:40.747899+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:40.747899+0000","last_undegraded":"2024-09-17T04:11:40.747899+0000","last_fullsized":"2024-09-17T04:11:40.747899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:25.125740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1527,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.512367+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:11:36.512367+0000","last_peered":"2024-09-17T04:11:36.512367+0000","last_clean":"2024-09-17T04:11:36.512367+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:36.512367+0000","last_undegraded":"2024-09-17T04:11:36.512367+0000","last_fullsized":"2024-09-17T04:11:36.512367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704062+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:11:42.704062+0000","last_peered":"2024-09-17T04:11:42.704062+0000","last_clean":"2024-09-17T04:11:42.704062+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:42.704062+0000","last_undegraded":"2024-09-17T04:11:42.704062+0000","last_fullsized":"2024-09-17T04:11:42.704062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742674+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:11:40.742674+0000","last_peered":"2024-09-17T04:11:40.742674+0000","last_clean":"2024-09-17T04:11:40.742674+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:11:40.742674+0000","last_undegraded":"2024-09-17T04:11:40.742674+0000","last_fullsized":"2024-09-17T04:11:40.742674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'69","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.706567+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:11:42.706567+0000","last_peered":"2024-09-17T04:11:42.706567+0000","last_clean":"2024-09-17T04:11:42.706567+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:42.706567+0000","last_undegraded":"2024-09-17T04:11:42.706567+0000","last_fullsized":"2024-09-17T04:11:42.706567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'59","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.708141+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:11:42.708141+0000","last_peered":"2024-09-17T04:11:42.708141+0000","last_clean":"2024-09-17T04:11:42.708141+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:42.708141+0000","last_undegraded":"2024-09-17T04:11:42.708141+0000","last_fullsized":"2024-09-17T04:11:42.708141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.713858+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:11:42.713858+0000","last_peered":"2024-09-17T04:11:42.713858+0000","last_clean":"2024-09-17T04:11:42.713858+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:11:42.713858+0000","last_undegraded":"2024-09-17T04:11:42.713858+0000","last_fullsized":"2024-09-17T04:11:42.713858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'52","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715092+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:11:42.715092+0000","last_peered":"2024-09-17T04:11:42.715092+0000","last_clean":"2024-09-17T04:11:42.715092+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:42.715092+0000","last_undegraded":"2024-09-17T04:11:42.715092+0000","last_fullsized":"2024-09-17T04:11:42.715092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719345+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:11:42.719345+0000","last_peered":"2024-09-17T04:11:42.719345+0000","last_clean":"2024-09-17T04:11:42.719345+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:42.719345+0000","last_undegraded":"2024-09-17T04:11:42.719345+0000","last_fullsized":"2024-09-17T04:11:42.719345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'24","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742444+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:11:40.742444+0000","last_peered":"2024-09-17T04:11:40.742444+0000","last_clean":"2024-09-17T04:11:40.742444+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:40.742444+0000","last_undegraded":"2024-09-17T04:11:40.742444+0000","last_fullsized":"2024-09-17T04:11:40.742444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'66","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718035+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:11:42.718035+0000","last_peered":"2024-09-17T04:11:42.718035+0000","last_clean":"2024-09-17T04:11:42.718035+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:42.718035+0000","last_undegraded":"2024-09-17T04:11:42.718035+0000","last_fullsized":"2024-09-17T04:11:42.718035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718786+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:11:42.718786+0000","last_peered":"2024-09-17T04:11:42.718786+0000","last_clean":"2024-09-17T04:11:42.718786+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:42.718786+0000","last_undegraded":"2024-09-17T04:11:42.718786+0000","last_fullsized":"2024-09-17T04:11:42.718786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714044+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:11:42.714044+0000","last_peered":"2024-09-17T04:11:42.714044+0000","last_clean":"2024-09-17T04:11:42.714044+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:42.714044+0000","last_undegraded":"2024-09-17T04:11:42.714044+0000","last_fullsized":"2024-09-17T04:11:42.714044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.485921+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:11:43.485921+0000","last_peered":"2024-09-17T04:11:43.485921+0000","last_clean":"2024-09-17T04:11:43.485921+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:11:43.485921+0000","last_undegraded":"2024-09-17T04:11:43.485921+0000","last_fullsized":"2024-09-17T04:11:43.485921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716464+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:11:42.716464+0000","last_peered":"2024-09-17T04:11:42.716464+0000","last_clean":"2024-09-17T04:11:42.716464+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:11:42.716464+0000","last_undegraded":"2024-09-17T04:11:42.716464+0000","last_fullsized":"2024-09-17T04:11:42.716464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729269+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:11:42.729269+0000","last_peered":"2024-09-17T04:11:42.729269+0000","last_clean":"2024-09-17T04:11:42.729269+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:11:42.729269+0000","last_undegraded":"2024-09-17T04:11:42.729269+0000","last_fullsized":"2024-09-17T04:11:42.729269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'62","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712957+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:11:42.712957+0000","last_peered":"2024-09-17T04:11:42.712957+0000","last_clean":"2024-09-17T04:11:42.712957+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:11:42.712957+0000","last_undegraded":"2024-09-17T04:11:42.712957+0000","last_fullsized":"2024-09-17T04:11:42.712957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.725600+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:11:42.725600+0000","last_peered":"2024-09-17T04:11:42.725600+0000","last_clean":"2024-09-17T04:11:42.725600+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:11:42.725600+0000","last_undegraded":"2024-09-17T04:11:42.725600+0000","last_fullsized":"2024-09-17T04:11:42.725600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716344+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:11:42.716344+0000","last_peered":"2024-09-17T04:11:42.716344+0000","last_clean":"2024-09-17T04:11:42.716344+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:42.716344+0000","last_undegraded":"2024-09-17T04:11:42.716344+0000","last_fullsized":"2024-09-17T04:11:42.716344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'55","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704448+0000","last_change":"2024-09-17T04:10:20.775054+0000","last_active":"2024-09-17T04:11:42.704448+0000","last_peered":"2024-09-17T04:11:42.704448+0000","last_clean":"2024-09-17T04:11:42.704448+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:42.704448+0000","last_undegraded":"2024-09-17T04:11:42.704448+0000","last_fullsized":"2024-09-17T04:11:42.704448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715936+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:11:42.715936+0000","last_peered":"2024-09-17T04:11:42.715936+0000","last_clean":"2024-09-17T04:11:42.715936+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:11:42.715936+0000","last_undegraded":"2024-09-17T04:11:42.715936+0000","last_fullsized":"2024-09-17T04:11:42.715936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.712704+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:11:40.712704+0000","last_peered":"2024-09-17T04:11:40.712704+0000","last_clean":"2024-09-17T04:11:40.712704+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:40.712704+0000","last_undegraded":"2024-09-17T04:11:40.712704+0000","last_fullsized":"2024-09-17T04:11:40.712704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'59","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714155+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:11:42.714155+0000","last_peered":"2024-09-17T04:11:42.714155+0000","last_clean":"2024-09-17T04:11:42.714155+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:42.714155+0000","last_undegraded":"2024-09-17T04:11:42.714155+0000","last_fullsized":"2024-09-17T04:11:42.714155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486743+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:11:43.486743+0000","last_peered":"2024-09-17T04:11:43.486743+0000","last_clean":"2024-09-17T04:11:43.486743+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:11:43.486743+0000","last_undegraded":"2024-09-17T04:11:43.486743+0000","last_fullsized":"2024-09-17T04:11:43.486743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.710056+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:11:42.710056+0000","last_peered":"2024-09-17T04:11:42.710056+0000","last_clean":"2024-09-17T04:11:42.710056+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:42.710056+0000","last_undegraded":"2024-09-17T04:11:42.710056+0000","last_fullsized":"2024-09-17T04:11:42.710056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714035+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:11:42.714035+0000","last_peered":"2024-09-17T04:11:42.714035+0000","last_clean":"2024-09-17T04:11:42.714035+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:11:42.714035+0000","last_undegraded":"2024-09-17T04:11:42.714035+0000","last_fullsized":"2024-09-17T04:11:42.714035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'53","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715797+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:11:42.715797+0000","last_peered":"2024-09-17T04:11:42.715797+0000","last_clean":"2024-09-17T04:11:42.715797+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:11:42.715797+0000","last_undegraded":"2024-09-17T04:11:42.715797+0000","last_fullsized":"2024-09-17T04:11:42.715797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728359+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:11:42.728359+0000","last_peered":"2024-09-17T04:11:42.728359+0000","last_clean":"2024-09-17T04:11:42.728359+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:11:42.728359+0000","last_undegraded":"2024-09-17T04:11:42.728359+0000","last_fullsized":"2024-09-17T04:11:42.728359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.717094+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:11:42.717094+0000","last_peered":"2024-09-17T04:11:42.717094+0000","last_clean":"2024-09-17T04:11:42.717094+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:11:42.717094+0000","last_undegraded":"2024-09-17T04:11:42.717094+0000","last_fullsized":"2024-09-17T04:11:42.717094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726049+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:11:42.726049+0000","last_peered":"2024-09-17T04:11:42.726049+0000","last_clean":"2024-09-17T04:11:42.726049+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:11:42.726049+0000","last_undegraded":"2024-09-17T04:11:42.726049+0000","last_fullsized":"2024-09-17T04:11:42.726049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487078+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:11:43.487078+0000","last_peered":"2024-09-17T04:11:43.487078+0000","last_clean":"2024-09-17T04:11:43.487078+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:11:43.487078+0000","last_undegraded":"2024-09-17T04:11:43.487078+0000","last_fullsized":"2024-09-17T04:11:43.487078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726135+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:11:42.726135+0000","last_peered":"2024-09-17T04:11:42.726135+0000","last_clean":"2024-09-17T04:11:42.726135+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:11:42.726135+0000","last_undegraded":"2024-09-17T04:11:42.726135+0000","last_fullsized":"2024-09-17T04:11:42.726135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'40","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486800+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:11:43.486800+0000","last_peered":"2024-09-17T04:11:43.486800+0000","last_clean":"2024-09-17T04:11:43.486800+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:11:43.486800+0000","last_undegraded":"2024-09-17T04:11:43.486800+0000","last_fullsized":"2024-09-17T04:11:43.486800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487461+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:11:43.487461+0000","last_peered":"2024-09-17T04:11:43.487461+0000","last_clean":"2024-09-17T04:11:43.487461+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:43.487461+0000","last_undegraded":"2024-09-17T04:11:43.487461+0000","last_fullsized":"2024-09-17T04:11:43.487461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.651303+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:11:40.651303+0000","last_peered":"2024-09-17T04:11:40.651303+0000","last_clean":"2024-09-17T04:11:40.651303+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:40.651303+0000","last_undegraded":"2024-09-17T04:11:40.651303+0000","last_fullsized":"2024-09-17T04:11:40.651303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726829+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:11:42.726829+0000","last_peered":"2024-09-17T04:11:42.726829+0000","last_clean":"2024-09-17T04:11:42.726829+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:11:42.726829+0000","last_undegraded":"2024-09-17T04:11:42.726829+0000","last_fullsized":"2024-09-17T04:11:42.726829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1405,"ondisk_log_size":1405,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3196,"ondisk_log_size":3196,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30882260,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":3042,"num_write_kb":32906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61825024,"data_stored":61764520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3737,"ondisk_log_size":3737,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":18288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":18726912,"data_stored":18536754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49068,"kb_used_data":13724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322772,"statfs":{"total":96636764160,"available":96586518528,"internally_reserved":0,"allocated":14053376,"data_stored":13861213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70504,"kb_used_data":12952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94301336,"statfs":{"total":96636764160,"available":96564568064,"internally_reserved":0,"allocated":13262848,"data_stored":13072075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,5,15,1,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":671744,"data_stored":488491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40268,"kb_used_data":9084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331572,"statfs":{"total":96636764160,"available":96595529728,"internally_reserved":0,"allocated":9302016,"data_stored":9105074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13746176,"data_stored":13735753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17936384,"data_stored":17929967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:11:45.678 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:11:45.678 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 -- 172.21.15.104:0/594467380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e700cce70 msgr2=0x7f5e700d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 --2- 172.21.15.104:0/594467380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e700cce70 0x7f5e700d04c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e700b18b0 tx=0x7f5e6802a8b0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 -- 172.21.15.104:0/594467380 shutdown_connections 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 --2- 172.21.15.104:0/594467380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e700cce70 0x7f5e700d04c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 --2- 172.21.15.104:0/594467380 >> v2:172.21.15.192:3300/0 conn(0x7f5e700d1ed0 0x7f5e700cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 -- 172.21.15.104:0/594467380 >> 172.21.15.104:0/594467380 conn(0x7f5e700cef40 msgr2=0x7f5e700cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 -- 172.21.15.104:0/594467380 shutdown_connections 2024-09-17T04:11:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.827+0000 7f5e778a9640 1 -- 172.21.15.104:0/594467380 wait complete. 2024-09-17T04:11:45.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.828+0000 7f5e778a9640 1 Processor -- start 2024-09-17T04:11:45.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.829+0000 7f5e778a9640 1 -- start start 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e700cce70 0x7f5e701e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e700d1ed0 0x7f5e70150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700d0d90 con 0x7f5e701536e0 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e700d0c10 con 0x7f5e700cce70 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e778a9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5e700d0f10 con 0x7f5e700d1ed0 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33094/0 (socket says 172.21.15.104:33094) 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 -- 172.21.15.104:0/808459019 learned_addr learned my addr 172.21.15.104:0/808459019 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75645640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e700cce70 0x7f5e701e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e74e44640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e700d1ed0 0x7f5e70150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 -- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e700d1ed0 msgr2=0x7f5e70150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e700d1ed0 0x7f5e70150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 -- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e700cce70 msgr2=0x7f5e701e7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e700cce70 0x7f5e701e7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 -- 172.21.15.104:0/808459019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e70150f40 con 0x7f5e701536e0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.830+0000 7f5e75e46640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009ca0 tx=0x7f5e68003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.831+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68031990 con 0x7f5e701536e0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.831+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e68031c20 con 0x7f5e701536e0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.831+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e680330d0 con 0x7f5e701536e0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.831+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e701e52e0 con 0x7f5e701536e0 2024-09-17T04:11:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.831+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e701e58a0 con 0x7f5e701536e0 2024-09-17T04:11:45.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.832+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e701e7ed0 con 0x7f5e701536e0 2024-09-17T04:11:45.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.832+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e68033270 con 0x7f5e701536e0 2024-09-17T04:11:45.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.833+0000 7f5e65ffb640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 0x7f5e5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:45.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.833+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5e680bc490 con 0x7f5e701536e0 2024-09-17T04:11:45.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.833+0000 7f5e75645640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 0x7f5e5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:45.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.834+0000 7f5e75645640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 0x7f5e5407b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c001720 tx=0x7f5e6c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:45.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:45.837+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e6803f030 con 0x7f5e701536e0 2024-09-17T04:11:46.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.010+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e701e8190 con 0x7f5e54078b90 2024-09-17T04:11:46.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.016+0000 7f5e65ffb640 1 -- 172.21.15.104:0/808459019 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333389 (secure 0 0 0) 0x7f5e6c001d00 con 0x7f5e54078b90 2024-09-17T04:11:46.019 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:11:46.021 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:11:46.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 msgr2=0x7f5e5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 0x7f5e5407b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c001720 tx=0x7f5e6c007e90 comp rx=0 tx=0).stop 2024-09-17T04:11:46.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 msgr2=0x7f5e701f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009ca0 tx=0x7f5e68003990 comp rx=0 tx=0).stop 2024-09-17T04:11:46.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 shutdown_connections 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5e54078b90 0x7f5e5407b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e701536e0 0x7f5e701f32c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e700d1ed0 0x7f5e70150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 --2- 172.21.15.104:0/808459019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e700cce70 0x7f5e701e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 >> 172.21.15.104:0/808459019 conn(0x7f5e700cef40 msgr2=0x7f5e700d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 shutdown_connections 2024-09-17T04:11:46.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.019+0000 7f5e778a9640 1 -- 172.21.15.104:0/808459019 wait complete. 2024-09-17T04:11:46.030 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-09-17T04:11:45.376318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31472628,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":93,"num_read_kb":434,"num_write":3143,"num_write_kb":34534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8410,"ondisk_log_size":8410,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347980,"kb_used_data":63820,"kb_used_omap":12,"kb_used_meta":284019,"kb_avail":754626740,"statfs":{"total":773094113280,"available":772737781760,"internally_reserved":0,"allocated":65351680,"data_stored":63828971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":290836016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,5,15,1,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22470747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":312,"num_write_kb":22258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002592"},"pg_stats":[{"pgid":"2.1f","version":"29'26","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507130+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:11:36.507130+0000","last_peered":"2024-09-17T04:11:36.507130+0000","last_clean":"2024-09-17T04:11:36.507130+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:36.507130+0000","last_undegraded":"2024-09-17T04:11:36.507130+0000","last_fullsized":"2024-09-17T04:11:36.507130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'46","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716562+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:11:42.716562+0000","last_peered":"2024-09-17T04:11:42.716562+0000","last_clean":"2024-09-17T04:11:42.716562+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:42.716562+0000","last_undegraded":"2024-09-17T04:11:42.716562+0000","last_fullsized":"2024-09-17T04:11:42.716562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.735676+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:11:40.735676+0000","last_peered":"2024-09-17T04:11:40.735676+0000","last_clean":"2024-09-17T04:11:40.735676+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:11:40.735676+0000","last_undegraded":"2024-09-17T04:11:40.735676+0000","last_fullsized":"2024-09-17T04:11:40.735676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'32","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.062024+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:11:39.062024+0000","last_peered":"2024-09-17T04:11:39.062024+0000","last_clean":"2024-09-17T04:11:39.062024+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:39.062024+0000","last_undegraded":"2024-09-17T04:11:39.062024+0000","last_fullsized":"2024-09-17T04:11:39.062024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'57","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.711752+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:11:42.711752+0000","last_peered":"2024-09-17T04:11:42.711752+0000","last_clean":"2024-09-17T04:11:42.711752+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:42.711752+0000","last_undegraded":"2024-09-17T04:11:42.711752+0000","last_fullsized":"2024-09-17T04:11:42.711752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.580956+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:11:41.580956+0000","last_peered":"2024-09-17T04:11:41.580956+0000","last_clean":"2024-09-17T04:11:41.580956+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:11:41.580956+0000","last_undegraded":"2024-09-17T04:11:41.580956+0000","last_fullsized":"2024-09-17T04:11:41.580956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'56","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.730702+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:11:42.730702+0000","last_peered":"2024-09-17T04:11:42.730702+0000","last_clean":"2024-09-17T04:11:42.730702+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:42.730702+0000","last_undegraded":"2024-09-17T04:11:42.730702+0000","last_fullsized":"2024-09-17T04:11:42.730702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5346473,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712715+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:11:42.712715+0000","last_peered":"2024-09-17T04:11:42.712715+0000","last_clean":"2024-09-17T04:11:42.712715+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:42.712715+0000","last_undegraded":"2024-09-17T04:11:42.712715+0000","last_fullsized":"2024-09-17T04:11:42.712715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'44","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579980+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:11:41.579980+0000","last_peered":"2024-09-17T04:11:41.579980+0000","last_clean":"2024-09-17T04:11:41.579980+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:11:41.579980+0000","last_undegraded":"2024-09-17T04:11:41.579980+0000","last_fullsized":"2024-09-17T04:11:41.579980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502238+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:11:36.502238+0000","last_peered":"2024-09-17T04:11:36.502238+0000","last_clean":"2024-09-17T04:11:36.502238+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:36.502238+0000","last_undegraded":"2024-09-17T04:11:36.502238+0000","last_fullsized":"2024-09-17T04:11:36.502238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712664+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:11:42.712664+0000","last_peered":"2024-09-17T04:11:42.712664+0000","last_clean":"2024-09-17T04:11:42.712664+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:42.712664+0000","last_undegraded":"2024-09-17T04:11:42.712664+0000","last_fullsized":"2024-09-17T04:11:42.712664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.750069+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:11:40.750069+0000","last_peered":"2024-09-17T04:11:40.750069+0000","last_clean":"2024-09-17T04:11:40.750069+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:11:40.750069+0000","last_undegraded":"2024-09-17T04:11:40.750069+0000","last_fullsized":"2024-09-17T04:11:40.750069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.711710+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:11:42.711710+0000","last_peered":"2024-09-17T04:11:42.711710+0000","last_clean":"2024-09-17T04:11:42.711710+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:42.711710+0000","last_undegraded":"2024-09-17T04:11:42.711710+0000","last_fullsized":"2024-09-17T04:11:42.711710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'230","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.496576+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:11:36.496576+0000","last_peered":"2024-09-17T04:11:36.496576+0000","last_clean":"2024-09-17T04:11:36.496576+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:36.496576+0000","last_undegraded":"2024-09-17T04:11:36.496576+0000","last_fullsized":"2024-09-17T04:11:36.496576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'41","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.748495+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:11:40.748495+0000","last_peered":"2024-09-17T04:11:40.748495+0000","last_clean":"2024-09-17T04:11:40.748495+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:40.748495+0000","last_undegraded":"2024-09-17T04:11:40.748495+0000","last_fullsized":"2024-09-17T04:11:40.748495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720958+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:11:42.720958+0000","last_peered":"2024-09-17T04:11:42.720958+0000","last_clean":"2024-09-17T04:11:42.720958+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:42.720958+0000","last_undegraded":"2024-09-17T04:11:42.720958+0000","last_fullsized":"2024-09-17T04:11:42.720958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500739+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:11:36.500739+0000","last_peered":"2024-09-17T04:11:36.500739+0000","last_clean":"2024-09-17T04:11:36.500739+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:36.500739+0000","last_undegraded":"2024-09-17T04:11:36.500739+0000","last_fullsized":"2024-09-17T04:11:36.500739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'48","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577284+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:11:41.577284+0000","last_peered":"2024-09-17T04:11:41.577284+0000","last_clean":"2024-09-17T04:11:41.577284+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:41.577284+0000","last_undegraded":"2024-09-17T04:11:41.577284+0000","last_fullsized":"2024-09-17T04:11:41.577284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714637+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:11:42.714637+0000","last_peered":"2024-09-17T04:11:42.714637+0000","last_clean":"2024-09-17T04:11:42.714637+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:42.714637+0000","last_undegraded":"2024-09-17T04:11:42.714637+0000","last_fullsized":"2024-09-17T04:11:42.714637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.506434+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:11:36.506434+0000","last_peered":"2024-09-17T04:11:36.506434+0000","last_clean":"2024-09-17T04:11:36.506434+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:36.506434+0000","last_undegraded":"2024-09-17T04:11:36.506434+0000","last_fullsized":"2024-09-17T04:11:36.506434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.727161+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:11:40.727161+0000","last_peered":"2024-09-17T04:11:40.727161+0000","last_clean":"2024-09-17T04:11:40.727161+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:11:40.727161+0000","last_undegraded":"2024-09-17T04:11:40.727161+0000","last_fullsized":"2024-09-17T04:11:40.727161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487545+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:11:43.487545+0000","last_peered":"2024-09-17T04:11:43.487545+0000","last_clean":"2024-09-17T04:11:43.487545+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:43.487545+0000","last_undegraded":"2024-09-17T04:11:43.487545+0000","last_fullsized":"2024-09-17T04:11:43.487545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.514869+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:11:36.514869+0000","last_peered":"2024-09-17T04:11:36.514869+0000","last_clean":"2024-09-17T04:11:36.514869+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:36.514869+0000","last_undegraded":"2024-09-17T04:11:36.514869+0000","last_fullsized":"2024-09-17T04:11:36.514869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738221+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:11:40.738221+0000","last_peered":"2024-09-17T04:11:40.738221+0000","last_clean":"2024-09-17T04:11:40.738221+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:40.738221+0000","last_undegraded":"2024-09-17T04:11:40.738221+0000","last_fullsized":"2024-09-17T04:11:40.738221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.488400+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:11:43.488400+0000","last_peered":"2024-09-17T04:11:43.488400+0000","last_clean":"2024-09-17T04:11:43.488400+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:43.488400+0000","last_undegraded":"2024-09-17T04:11:43.488400+0000","last_fullsized":"2024-09-17T04:11:43.488400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'26","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.490748+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:11:42.490748+0000","last_peered":"2024-09-17T04:11:42.490748+0000","last_clean":"2024-09-17T04:11:42.490748+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:42.490748+0000","last_undegraded":"2024-09-17T04:11:42.490748+0000","last_fullsized":"2024-09-17T04:11:42.490748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'46","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728163+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:11:40.728163+0000","last_peered":"2024-09-17T04:11:40.728163+0000","last_clean":"2024-09-17T04:11:40.728163+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:40.728163+0000","last_undegraded":"2024-09-17T04:11:40.728163+0000","last_fullsized":"2024-09-17T04:11:40.728163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715413+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:11:42.715413+0000","last_peered":"2024-09-17T04:11:42.715413+0000","last_clean":"2024-09-17T04:11:42.715413+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:42.715413+0000","last_undegraded":"2024-09-17T04:11:42.715413+0000","last_fullsized":"2024-09-17T04:11:42.715413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'49","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.360369+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:11:40.360369+0000","last_peered":"2024-09-17T04:11:40.360369+0000","last_clean":"2024-09-17T04:11:40.360369+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:40.360369+0000","last_undegraded":"2024-09-17T04:11:40.360369+0000","last_fullsized":"2024-09-17T04:11:40.360369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'51","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579480+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:11:41.579480+0000","last_peered":"2024-09-17T04:11:41.579480+0000","last_clean":"2024-09-17T04:11:41.579480+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:11:41.579480+0000","last_undegraded":"2024-09-17T04:11:41.579480+0000","last_fullsized":"2024-09-17T04:11:41.579480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'28","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.706310+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:11:40.706310+0000","last_peered":"2024-09-17T04:11:40.706310+0000","last_clean":"2024-09-17T04:11:40.706310+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:40.706310+0000","last_undegraded":"2024-09-17T04:11:40.706310+0000","last_fullsized":"2024-09-17T04:11:40.706310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.508913+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:11:36.508913+0000","last_peered":"2024-09-17T04:11:36.508913+0000","last_clean":"2024-09-17T04:11:36.508913+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:36.508913+0000","last_undegraded":"2024-09-17T04:11:36.508913+0000","last_fullsized":"2024-09-17T04:11:36.508913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.729414+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:11:40.729414+0000","last_peered":"2024-09-17T04:11:40.729414+0000","last_clean":"2024-09-17T04:11:40.729414+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:11:40.729414+0000","last_undegraded":"2024-09-17T04:11:40.729414+0000","last_fullsized":"2024-09-17T04:11:40.729414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'46","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487146+0000","last_change":"2024-09-17T04:10:20.524590+0000","last_active":"2024-09-17T04:11:43.487146+0000","last_peered":"2024-09-17T04:11:43.487146+0000","last_clean":"2024-09-17T04:11:43.487146+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:43.487146+0000","last_undegraded":"2024-09-17T04:11:43.487146+0000","last_fullsized":"2024-09-17T04:11:43.487146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498169+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:11:36.498169+0000","last_peered":"2024-09-17T04:11:36.498169+0000","last_clean":"2024-09-17T04:11:36.498169+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:36.498169+0000","last_undegraded":"2024-09-17T04:11:36.498169+0000","last_fullsized":"2024-09-17T04:11:36.498169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734857+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:11:40.734857+0000","last_peered":"2024-09-17T04:11:40.734857+0000","last_clean":"2024-09-17T04:11:40.734857+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:40.734857+0000","last_undegraded":"2024-09-17T04:11:40.734857+0000","last_fullsized":"2024-09-17T04:11:40.734857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.703167+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:11:42.703167+0000","last_peered":"2024-09-17T04:11:42.703167+0000","last_clean":"2024-09-17T04:11:42.703167+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:42.703167+0000","last_undegraded":"2024-09-17T04:11:42.703167+0000","last_fullsized":"2024-09-17T04:11:42.703167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'24","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.505881+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:11:42.505881+0000","last_peered":"2024-09-17T04:11:42.505881+0000","last_clean":"2024-09-17T04:11:42.505881+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:42.505881+0000","last_undegraded":"2024-09-17T04:11:42.505881+0000","last_fullsized":"2024-09-17T04:11:42.505881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738012+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:11:40.738012+0000","last_peered":"2024-09-17T04:11:40.738012+0000","last_clean":"2024-09-17T04:11:40.738012+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:11:40.738012+0000","last_undegraded":"2024-09-17T04:11:40.738012+0000","last_fullsized":"2024-09-17T04:11:40.738012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'25","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.499766+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:11:41.499766+0000","last_peered":"2024-09-17T04:11:41.499766+0000","last_clean":"2024-09-17T04:11:41.499766+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:41.499766+0000","last_undegraded":"2024-09-17T04:11:41.499766+0000","last_fullsized":"2024-09-17T04:11:41.499766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'56","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.480749+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:11:43.480749+0000","last_peered":"2024-09-17T04:11:43.480749+0000","last_clean":"2024-09-17T04:11:43.480749+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:43.480749+0000","last_undegraded":"2024-09-17T04:11:43.480749+0000","last_fullsized":"2024-09-17T04:11:43.480749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":27,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.720137+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:11:40.720137+0000","last_peered":"2024-09-17T04:11:40.720137+0000","last_clean":"2024-09-17T04:11:40.720137+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:11:40.720137+0000","last_undegraded":"2024-09-17T04:11:40.720137+0000","last_fullsized":"2024-09-17T04:11:40.720137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716682+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:11:42.716682+0000","last_peered":"2024-09-17T04:11:42.716682+0000","last_clean":"2024-09-17T04:11:42.716682+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:42.716682+0000","last_undegraded":"2024-09-17T04:11:42.716682+0000","last_fullsized":"2024-09-17T04:11:42.716682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:01.759838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'21","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.512580+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:11:38.512580+0000","last_peered":"2024-09-17T04:11:38.512580+0000","last_clean":"2024-09-17T04:11:38.512580+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:38.512580+0000","last_undegraded":"2024-09-17T04:11:38.512580+0000","last_fullsized":"2024-09-17T04:11:38.512580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734313+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:11:40.734313+0000","last_peered":"2024-09-17T04:11:40.734313+0000","last_clean":"2024-09-17T04:11:40.734313+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:40.734313+0000","last_undegraded":"2024-09-17T04:11:40.734313+0000","last_fullsized":"2024-09-17T04:11:40.734313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'57","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.709660+0000","last_change":"2024-09-17T04:10:20.524400+0000","last_active":"2024-09-17T04:11:42.709660+0000","last_peered":"2024-09-17T04:11:42.709660+0000","last_clean":"2024-09-17T04:11:42.709660+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:42.709660+0000","last_undegraded":"2024-09-17T04:11:42.709660+0000","last_fullsized":"2024-09-17T04:11:42.709660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'20","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.553052+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:11:40.553052+0000","last_peered":"2024-09-17T04:11:40.553052+0000","last_clean":"2024-09-17T04:11:40.553052+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:40.553052+0000","last_undegraded":"2024-09-17T04:11:40.553052+0000","last_fullsized":"2024-09-17T04:11:40.553052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:10:20.773163+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:10:20.773163+0000","last_peered":"2024-09-17T04:10:20.773163+0000","last_clean":"2024-09-17T04:10:20.773163+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:10:20.773163+0000","last_undegraded":"2024-09-17T04:10:20.773163+0000","last_fullsized":"2024-09-17T04:10:20.773163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'35","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.744925+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:11:40.744925+0000","last_peered":"2024-09-17T04:11:40.744925+0000","last_clean":"2024-09-17T04:11:40.744925+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:11:40.744925+0000","last_undegraded":"2024-09-17T04:11:40.744925+0000","last_fullsized":"2024-09-17T04:11:40.744925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726744+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:11:42.726744+0000","last_peered":"2024-09-17T04:11:42.726744+0000","last_clean":"2024-09-17T04:11:42.726744+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:42.726744+0000","last_undegraded":"2024-09-17T04:11:42.726744+0000","last_fullsized":"2024-09-17T04:11:42.726744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507264+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:11:36.507264+0000","last_peered":"2024-09-17T04:11:36.507264+0000","last_clean":"2024-09-17T04:11:36.507264+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:36.507264+0000","last_undegraded":"2024-09-17T04:11:36.507264+0000","last_fullsized":"2024-09-17T04:11:36.507264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'34","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747834+0000","last_change":"2024-09-17T04:10:20.777190+0000","last_active":"2024-09-17T04:11:40.747834+0000","last_peered":"2024-09-17T04:11:40.747834+0000","last_clean":"2024-09-17T04:11:40.747834+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:11:40.747834+0000","last_undegraded":"2024-09-17T04:11:40.747834+0000","last_fullsized":"2024-09-17T04:11:40.747834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704033+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:11:42.704033+0000","last_peered":"2024-09-17T04:11:42.704033+0000","last_clean":"2024-09-17T04:11:42.704033+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:42.704033+0000","last_undegraded":"2024-09-17T04:11:42.704033+0000","last_fullsized":"2024-09-17T04:11:42.704033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.495819+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:11:36.495819+0000","last_peered":"2024-09-17T04:11:36.495819+0000","last_clean":"2024-09-17T04:11:36.495819+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:36.495819+0000","last_undegraded":"2024-09-17T04:11:36.495819+0000","last_fullsized":"2024-09-17T04:11:36.495819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577119+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:11:41.577119+0000","last_peered":"2024-09-17T04:11:41.577119+0000","last_clean":"2024-09-17T04:11:41.577119+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:11:41.577119+0000","last_undegraded":"2024-09-17T04:11:41.577119+0000","last_fullsized":"2024-09-17T04:11:41.577119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728585+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:11:42.728585+0000","last_peered":"2024-09-17T04:11:42.728585+0000","last_clean":"2024-09-17T04:11:42.728585+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:42.728585+0000","last_undegraded":"2024-09-17T04:11:42.728585+0000","last_fullsized":"2024-09-17T04:11:42.728585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.509070+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:11:36.509070+0000","last_peered":"2024-09-17T04:11:36.509070+0000","last_clean":"2024-09-17T04:11:36.509070+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:36.509070+0000","last_undegraded":"2024-09-17T04:11:36.509070+0000","last_fullsized":"2024-09-17T04:11:36.509070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'50","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.576524+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:11:41.576524+0000","last_peered":"2024-09-17T04:11:41.576524+0000","last_clean":"2024-09-17T04:11:41.576524+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:11:41.576524+0000","last_undegraded":"2024-09-17T04:11:41.576524+0000","last_fullsized":"2024-09-17T04:11:41.576524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726118+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:11:42.726118+0000","last_peered":"2024-09-17T04:11:42.726118+0000","last_clean":"2024-09-17T04:11:42.726118+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:11:42.726118+0000","last_undegraded":"2024-09-17T04:11:42.726118+0000","last_fullsized":"2024-09-17T04:11:42.726118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498143+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:11:36.498143+0000","last_peered":"2024-09-17T04:11:36.498143+0000","last_clean":"2024-09-17T04:11:36.498143+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:36.498143+0000","last_undegraded":"2024-09-17T04:11:36.498143+0000","last_fullsized":"2024-09-17T04:11:36.498143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'47","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734413+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:11:40.734413+0000","last_peered":"2024-09-17T04:11:40.734413+0000","last_clean":"2024-09-17T04:11:40.734413+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:40.734413+0000","last_undegraded":"2024-09-17T04:11:40.734413+0000","last_fullsized":"2024-09-17T04:11:40.734413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.724540+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:11:42.724540+0000","last_peered":"2024-09-17T04:11:42.724540+0000","last_clean":"2024-09-17T04:11:42.724540+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:11:42.724540+0000","last_undegraded":"2024-09-17T04:11:42.724540+0000","last_fullsized":"2024-09-17T04:11:42.724540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'33","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486531+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:11:43.486531+0000","last_peered":"2024-09-17T04:11:43.486531+0000","last_clean":"2024-09-17T04:11:43.486531+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:43.486531+0000","last_undegraded":"2024-09-17T04:11:43.486531+0000","last_fullsized":"2024-09-17T04:11:43.486531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'54","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.708373+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:11:40.708373+0000","last_peered":"2024-09-17T04:11:40.708373+0000","last_clean":"2024-09-17T04:11:40.708373+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:11:40.708373+0000","last_undegraded":"2024-09-17T04:11:40.708373+0000","last_fullsized":"2024-09-17T04:11:40.708373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.702217+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:11:42.702217+0000","last_peered":"2024-09-17T04:11:42.702217+0000","last_clean":"2024-09-17T04:11:42.702217+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:42.702217+0000","last_undegraded":"2024-09-17T04:11:42.702217+0000","last_fullsized":"2024-09-17T04:11:42.702217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'30","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.862284+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:11:39.862284+0000","last_peered":"2024-09-17T04:11:39.862284+0000","last_clean":"2024-09-17T04:11:39.862284+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:39.862284+0000","last_undegraded":"2024-09-17T04:11:39.862284+0000","last_fullsized":"2024-09-17T04:11:39.862284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'43","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.739540+0000","last_change":"2024-09-17T04:10:20.775487+0000","last_active":"2024-09-17T04:11:40.739540+0000","last_peered":"2024-09-17T04:11:40.739540+0000","last_clean":"2024-09-17T04:11:40.739540+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:11:40.739540+0000","last_undegraded":"2024-09-17T04:11:40.739540+0000","last_fullsized":"2024-09-17T04:11:40.739540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:23.072496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729353+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:11:42.729353+0000","last_peered":"2024-09-17T04:11:42.729353+0000","last_clean":"2024-09-17T04:11:42.729353+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:11:42.729353+0000","last_undegraded":"2024-09-17T04:11:42.729353+0000","last_fullsized":"2024-09-17T04:11:42.729353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'35","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.672344+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:11:38.672344+0000","last_peered":"2024-09-17T04:11:38.672344+0000","last_clean":"2024-09-17T04:11:38.672344+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:38.672344+0000","last_undegraded":"2024-09-17T04:11:38.672344+0000","last_fullsized":"2024-09-17T04:11:38.672344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'34","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.714640+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:11:40.714640+0000","last_peered":"2024-09-17T04:11:40.714640+0000","last_clean":"2024-09-17T04:11:40.714640+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:11:40.714640+0000","last_undegraded":"2024-09-17T04:11:40.714640+0000","last_fullsized":"2024-09-17T04:11:40.714640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487153+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:11:43.487153+0000","last_peered":"2024-09-17T04:11:43.487153+0000","last_clean":"2024-09-17T04:11:43.487153+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:43.487153+0000","last_undegraded":"2024-09-17T04:11:43.487153+0000","last_fullsized":"2024-09-17T04:11:43.487153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'17","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.511219+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:11:36.511219+0000","last_peered":"2024-09-17T04:11:36.511219+0000","last_clean":"2024-09-17T04:11:36.511219+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:36.511219+0000","last_undegraded":"2024-09-17T04:11:36.511219+0000","last_fullsized":"2024-09-17T04:11:36.511219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'38","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.578153+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:11:41.578153+0000","last_peered":"2024-09-17T04:11:41.578153+0000","last_clean":"2024-09-17T04:11:41.578153+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:11:41.578153+0000","last_undegraded":"2024-09-17T04:11:41.578153+0000","last_fullsized":"2024-09-17T04:11:41.578153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726285+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:11:42.726285+0000","last_peered":"2024-09-17T04:11:42.726285+0000","last_clean":"2024-09-17T04:11:42.726285+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:11:42.726285+0000","last_undegraded":"2024-09-17T04:11:42.726285+0000","last_fullsized":"2024-09-17T04:11:42.726285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1191","reported_seq":1218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.685750+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:11:38.685750+0000","last_peered":"2024-09-17T04:11:38.685750+0000","last_clean":"2024-09-17T04:11:38.685750+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:38.685750+0000","last_undegraded":"2024-09-17T04:11:38.685750+0000","last_fullsized":"2024-09-17T04:11:38.685750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":5144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.715571+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:11:40.715571+0000","last_peered":"2024-09-17T04:11:40.715571+0000","last_clean":"2024-09-17T04:11:40.715571+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:11:40.715571+0000","last_undegraded":"2024-09-17T04:11:40.715571+0000","last_fullsized":"2024-09-17T04:11:40.715571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715263+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:11:42.715263+0000","last_peered":"2024-09-17T04:11:42.715263+0000","last_clean":"2024-09-17T04:11:42.715263+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:42.715263+0000","last_undegraded":"2024-09-17T04:11:42.715263+0000","last_fullsized":"2024-09-17T04:11:42.715263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.939447+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:11:39.939447+0000","last_peered":"2024-09-17T04:11:39.939447+0000","last_clean":"2024-09-17T04:11:39.939447+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:39.939447+0000","last_undegraded":"2024-09-17T04:11:39.939447+0000","last_fullsized":"2024-09-17T04:11:39.939447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728486+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:11:40.728486+0000","last_peered":"2024-09-17T04:11:40.728486+0000","last_clean":"2024-09-17T04:11:40.728486+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:11:40.728486+0000","last_undegraded":"2024-09-17T04:11:40.728486+0000","last_fullsized":"2024-09-17T04:11:40.728486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714395+0000","last_change":"2024-09-17T04:10:20.772111+0000","last_active":"2024-09-17T04:11:42.714395+0000","last_peered":"2024-09-17T04:11:42.714395+0000","last_clean":"2024-09-17T04:11:42.714395+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:42.714395+0000","last_undegraded":"2024-09-17T04:11:42.714395+0000","last_fullsized":"2024-09-17T04:11:42.714395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.090846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.503007+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:11:36.503007+0000","last_peered":"2024-09-17T04:11:36.503007+0000","last_clean":"2024-09-17T04:11:36.503007+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:36.503007+0000","last_undegraded":"2024-09-17T04:11:36.503007+0000","last_fullsized":"2024-09-17T04:11:36.503007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.724578+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:11:40.724578+0000","last_peered":"2024-09-17T04:11:40.724578+0000","last_clean":"2024-09-17T04:11:40.724578+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:11:40.724578+0000","last_undegraded":"2024-09-17T04:11:40.724578+0000","last_fullsized":"2024-09-17T04:11:40.724578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'73","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486351+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:11:43.486351+0000","last_peered":"2024-09-17T04:11:43.486351+0000","last_clean":"2024-09-17T04:11:43.486351+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:43.486351+0000","last_undegraded":"2024-09-17T04:11:43.486351+0000","last_fullsized":"2024-09-17T04:11:43.486351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.501810+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:11:36.501810+0000","last_peered":"2024-09-17T04:11:36.501810+0000","last_clean":"2024-09-17T04:11:36.501810+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:36.501810+0000","last_undegraded":"2024-09-17T04:11:36.501810+0000","last_fullsized":"2024-09-17T04:11:36.501810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747723+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:11:40.747723+0000","last_peered":"2024-09-17T04:11:40.747723+0000","last_clean":"2024-09-17T04:11:40.747723+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:11:40.747723+0000","last_undegraded":"2024-09-17T04:11:40.747723+0000","last_fullsized":"2024-09-17T04:11:40.747723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'43","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.582824+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:11:41.582824+0000","last_peered":"2024-09-17T04:11:41.582824+0000","last_clean":"2024-09-17T04:11:41.582824+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:11:41.582824+0000","last_undegraded":"2024-09-17T04:11:41.582824+0000","last_fullsized":"2024-09-17T04:11:41.582824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.709809+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:11:40.709809+0000","last_peered":"2024-09-17T04:11:40.709809+0000","last_clean":"2024-09-17T04:11:40.709809+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:11:40.709809+0000","last_undegraded":"2024-09-17T04:11:40.709809+0000","last_fullsized":"2024-09-17T04:11:40.709809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.483640+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:11:36.483640+0000","last_peered":"2024-09-17T04:11:36.483640+0000","last_clean":"2024-09-17T04:11:36.483640+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:36.483640+0000","last_undegraded":"2024-09-17T04:11:36.483640+0000","last_fullsized":"2024-09-17T04:11:36.483640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'50","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728936+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:11:40.728936+0000","last_peered":"2024-09-17T04:11:40.728936+0000","last_clean":"2024-09-17T04:11:40.728936+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:11:40.728936+0000","last_undegraded":"2024-09-17T04:11:40.728936+0000","last_fullsized":"2024-09-17T04:11:40.728936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'65","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720993+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:11:42.720993+0000","last_peered":"2024-09-17T04:11:42.720993+0000","last_clean":"2024-09-17T04:11:42.720993+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:42.720993+0000","last_undegraded":"2024-09-17T04:11:42.720993+0000","last_fullsized":"2024-09-17T04:11:42.720993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500242+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:11:36.500242+0000","last_peered":"2024-09-17T04:11:36.500242+0000","last_clean":"2024-09-17T04:11:36.500242+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:36.500242+0000","last_undegraded":"2024-09-17T04:11:36.500242+0000","last_fullsized":"2024-09-17T04:11:36.500242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.400201+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:11:37.400201+0000","last_peered":"2024-09-17T04:11:37.400201+0000","last_clean":"2024-09-17T04:11:37.400201+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:37.400201+0000","last_undegraded":"2024-09-17T04:11:37.400201+0000","last_fullsized":"2024-09-17T04:11:37.400201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719121+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:11:42.719121+0000","last_peered":"2024-09-17T04:11:42.719121+0000","last_clean":"2024-09-17T04:11:42.719121+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:42.719121+0000","last_undegraded":"2024-09-17T04:11:42.719121+0000","last_fullsized":"2024-09-17T04:11:42.719121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747899+0000","last_change":"2024-09-17T04:10:20.525430+0000","last_active":"2024-09-17T04:11:40.747899+0000","last_peered":"2024-09-17T04:11:40.747899+0000","last_clean":"2024-09-17T04:11:40.747899+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:40.747899+0000","last_undegraded":"2024-09-17T04:11:40.747899+0000","last_fullsized":"2024-09-17T04:11:40.747899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:25.125740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1527,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.512367+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:11:36.512367+0000","last_peered":"2024-09-17T04:11:36.512367+0000","last_clean":"2024-09-17T04:11:36.512367+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:36.512367+0000","last_undegraded":"2024-09-17T04:11:36.512367+0000","last_fullsized":"2024-09-17T04:11:36.512367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704062+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:11:42.704062+0000","last_peered":"2024-09-17T04:11:42.704062+0000","last_clean":"2024-09-17T04:11:42.704062+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:42.704062+0000","last_undegraded":"2024-09-17T04:11:42.704062+0000","last_fullsized":"2024-09-17T04:11:42.704062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742674+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:11:40.742674+0000","last_peered":"2024-09-17T04:11:40.742674+0000","last_clean":"2024-09-17T04:11:40.742674+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:11:40.742674+0000","last_undegraded":"2024-09-17T04:11:40.742674+0000","last_fullsized":"2024-09-17T04:11:40.742674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'69","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.706567+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:11:42.706567+0000","last_peered":"2024-09-17T04:11:42.706567+0000","last_clean":"2024-09-17T04:11:42.706567+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:42.706567+0000","last_undegraded":"2024-09-17T04:11:42.706567+0000","last_fullsized":"2024-09-17T04:11:42.706567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'59","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.708141+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:11:42.708141+0000","last_peered":"2024-09-17T04:11:42.708141+0000","last_clean":"2024-09-17T04:11:42.708141+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:42.708141+0000","last_undegraded":"2024-09-17T04:11:42.708141+0000","last_fullsized":"2024-09-17T04:11:42.708141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.713858+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:11:42.713858+0000","last_peered":"2024-09-17T04:11:42.713858+0000","last_clean":"2024-09-17T04:11:42.713858+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:11:42.713858+0000","last_undegraded":"2024-09-17T04:11:42.713858+0000","last_fullsized":"2024-09-17T04:11:42.713858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'52","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715092+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:11:42.715092+0000","last_peered":"2024-09-17T04:11:42.715092+0000","last_clean":"2024-09-17T04:11:42.715092+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:42.715092+0000","last_undegraded":"2024-09-17T04:11:42.715092+0000","last_fullsized":"2024-09-17T04:11:42.715092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719345+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:11:42.719345+0000","last_peered":"2024-09-17T04:11:42.719345+0000","last_clean":"2024-09-17T04:11:42.719345+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:42.719345+0000","last_undegraded":"2024-09-17T04:11:42.719345+0000","last_fullsized":"2024-09-17T04:11:42.719345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'24","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742444+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:11:40.742444+0000","last_peered":"2024-09-17T04:11:40.742444+0000","last_clean":"2024-09-17T04:11:40.742444+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:40.742444+0000","last_undegraded":"2024-09-17T04:11:40.742444+0000","last_fullsized":"2024-09-17T04:11:40.742444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'66","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718035+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:11:42.718035+0000","last_peered":"2024-09-17T04:11:42.718035+0000","last_clean":"2024-09-17T04:11:42.718035+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:42.718035+0000","last_undegraded":"2024-09-17T04:11:42.718035+0000","last_fullsized":"2024-09-17T04:11:42.718035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718786+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:11:42.718786+0000","last_peered":"2024-09-17T04:11:42.718786+0000","last_clean":"2024-09-17T04:11:42.718786+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:42.718786+0000","last_undegraded":"2024-09-17T04:11:42.718786+0000","last_fullsized":"2024-09-17T04:11:42.718786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714044+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:11:42.714044+0000","last_peered":"2024-09-17T04:11:42.714044+0000","last_clean":"2024-09-17T04:11:42.714044+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:42.714044+0000","last_undegraded":"2024-09-17T04:11:42.714044+0000","last_fullsized":"2024-09-17T04:11:42.714044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.485921+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:11:43.485921+0000","last_peered":"2024-09-17T04:11:43.485921+0000","last_clean":"2024-09-17T04:11:43.485921+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:11:43.485921+0000","last_undegraded":"2024-09-17T04:11:43.485921+0000","last_fullsized":"2024-09-17T04:11:43.485921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716464+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:11:42.716464+0000","last_peered":"2024-09-17T04:11:42.716464+0000","last_clean":"2024-09-17T04:11:42.716464+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:11:42.716464+0000","last_undegraded":"2024-09-17T04:11:42.716464+0000","last_fullsized":"2024-09-17T04:11:42.716464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729269+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:11:42.729269+0000","last_peered":"2024-09-17T04:11:42.729269+0000","last_clean":"2024-09-17T04:11:42.729269+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:11:42.729269+0000","last_undegraded":"2024-09-17T04:11:42.729269+0000","last_fullsized":"2024-09-17T04:11:42.729269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'62","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712957+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:11:42.712957+0000","last_peered":"2024-09-17T04:11:42.712957+0000","last_clean":"2024-09-17T04:11:42.712957+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:11:42.712957+0000","last_undegraded":"2024-09-17T04:11:42.712957+0000","last_fullsized":"2024-09-17T04:11:42.712957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.725600+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:11:42.725600+0000","last_peered":"2024-09-17T04:11:42.725600+0000","last_clean":"2024-09-17T04:11:42.725600+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:11:42.725600+0000","last_undegraded":"2024-09-17T04:11:42.725600+0000","last_fullsized":"2024-09-17T04:11:42.725600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716344+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:11:42.716344+0000","last_peered":"2024-09-17T04:11:42.716344+0000","last_clean":"2024-09-17T04:11:42.716344+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:42.716344+0000","last_undegraded":"2024-09-17T04:11:42.716344+0000","last_fullsized":"2024-09-17T04:11:42.716344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'55","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704448+0000","last_change":"2024-09-17T04:10:20.775054+0000","last_active":"2024-09-17T04:11:42.704448+0000","last_peered":"2024-09-17T04:11:42.704448+0000","last_clean":"2024-09-17T04:11:42.704448+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:42.704448+0000","last_undegraded":"2024-09-17T04:11:42.704448+0000","last_fullsized":"2024-09-17T04:11:42.704448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715936+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:11:42.715936+0000","last_peered":"2024-09-17T04:11:42.715936+0000","last_clean":"2024-09-17T04:11:42.715936+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:11:42.715936+0000","last_undegraded":"2024-09-17T04:11:42.715936+0000","last_fullsized":"2024-09-17T04:11:42.715936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.712704+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:11:40.712704+0000","last_peered":"2024-09-17T04:11:40.712704+0000","last_clean":"2024-09-17T04:11:40.712704+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:40.712704+0000","last_undegraded":"2024-09-17T04:11:40.712704+0000","last_fullsized":"2024-09-17T04:11:40.712704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'59","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714155+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:11:42.714155+0000","last_peered":"2024-09-17T04:11:42.714155+0000","last_clean":"2024-09-17T04:11:42.714155+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:42.714155+0000","last_undegraded":"2024-09-17T04:11:42.714155+0000","last_fullsized":"2024-09-17T04:11:42.714155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486743+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:11:43.486743+0000","last_peered":"2024-09-17T04:11:43.486743+0000","last_clean":"2024-09-17T04:11:43.486743+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:11:43.486743+0000","last_undegraded":"2024-09-17T04:11:43.486743+0000","last_fullsized":"2024-09-17T04:11:43.486743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.710056+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:11:42.710056+0000","last_peered":"2024-09-17T04:11:42.710056+0000","last_clean":"2024-09-17T04:11:42.710056+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:42.710056+0000","last_undegraded":"2024-09-17T04:11:42.710056+0000","last_fullsized":"2024-09-17T04:11:42.710056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714035+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:11:42.714035+0000","last_peered":"2024-09-17T04:11:42.714035+0000","last_clean":"2024-09-17T04:11:42.714035+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:11:42.714035+0000","last_undegraded":"2024-09-17T04:11:42.714035+0000","last_fullsized":"2024-09-17T04:11:42.714035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'53","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715797+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:11:42.715797+0000","last_peered":"2024-09-17T04:11:42.715797+0000","last_clean":"2024-09-17T04:11:42.715797+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:11:42.715797+0000","last_undegraded":"2024-09-17T04:11:42.715797+0000","last_fullsized":"2024-09-17T04:11:42.715797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728359+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:11:42.728359+0000","last_peered":"2024-09-17T04:11:42.728359+0000","last_clean":"2024-09-17T04:11:42.728359+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:11:42.728359+0000","last_undegraded":"2024-09-17T04:11:42.728359+0000","last_fullsized":"2024-09-17T04:11:42.728359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.717094+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:11:42.717094+0000","last_peered":"2024-09-17T04:11:42.717094+0000","last_clean":"2024-09-17T04:11:42.717094+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:11:42.717094+0000","last_undegraded":"2024-09-17T04:11:42.717094+0000","last_fullsized":"2024-09-17T04:11:42.717094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726049+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:11:42.726049+0000","last_peered":"2024-09-17T04:11:42.726049+0000","last_clean":"2024-09-17T04:11:42.726049+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:11:42.726049+0000","last_undegraded":"2024-09-17T04:11:42.726049+0000","last_fullsized":"2024-09-17T04:11:42.726049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487078+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:11:43.487078+0000","last_peered":"2024-09-17T04:11:43.487078+0000","last_clean":"2024-09-17T04:11:43.487078+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:11:43.487078+0000","last_undegraded":"2024-09-17T04:11:43.487078+0000","last_fullsized":"2024-09-17T04:11:43.487078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726135+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:11:42.726135+0000","last_peered":"2024-09-17T04:11:42.726135+0000","last_clean":"2024-09-17T04:11:42.726135+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:11:42.726135+0000","last_undegraded":"2024-09-17T04:11:42.726135+0000","last_fullsized":"2024-09-17T04:11:42.726135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'40","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486800+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:11:43.486800+0000","last_peered":"2024-09-17T04:11:43.486800+0000","last_clean":"2024-09-17T04:11:43.486800+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:11:43.486800+0000","last_undegraded":"2024-09-17T04:11:43.486800+0000","last_fullsized":"2024-09-17T04:11:43.486800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487461+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:11:43.487461+0000","last_peered":"2024-09-17T04:11:43.487461+0000","last_clean":"2024-09-17T04:11:43.487461+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:43.487461+0000","last_undegraded":"2024-09-17T04:11:43.487461+0000","last_fullsized":"2024-09-17T04:11:43.487461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:28.618946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.651303+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:11:40.651303+0000","last_peered":"2024-09-17T04:11:40.651303+0000","last_clean":"2024-09-17T04:11:40.651303+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:40.651303+0000","last_undegraded":"2024-09-17T04:11:40.651303+0000","last_fullsized":"2024-09-17T04:11:40.651303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726829+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:11:42.726829+0000","last_peered":"2024-09-17T04:11:42.726829+0000","last_clean":"2024-09-17T04:11:42.726829+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:11:42.726829+0000","last_undegraded":"2024-09-17T04:11:42.726829+0000","last_fullsized":"2024-09-17T04:11:42.726829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1405,"ondisk_log_size":1405,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3196,"ondisk_log_size":3196,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30882260,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":3042,"num_write_kb":32906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61825024,"data_stored":61764520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3737,"ondisk_log_size":3737,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53632,"kb_used_data":18288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318208,"statfs":{"total":96636764160,"available":96581844992,"internally_reserved":0,"allocated":18726912,"data_stored":18536754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49068,"kb_used_data":13724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322772,"statfs":{"total":96636764160,"available":96586518528,"internally_reserved":0,"allocated":14053376,"data_stored":13861213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70504,"kb_used_data":12952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94301336,"statfs":{"total":96636764160,"available":96564568064,"internally_reserved":0,"allocated":13262848,"data_stored":13072075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,5,15,1,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":671744,"data_stored":488491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40268,"kb_used_data":9084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331572,"statfs":{"total":96636764160,"available":96595529728,"internally_reserved":0,"allocated":9302016,"data_stored":9105074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13746176,"data_stored":13735753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17936384,"data_stored":17929967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:11:46.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 -- 172.21.15.104:0/598552062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 msgr2=0x7f20c4155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 --2- 172.21.15.104:0/598552062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4155af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20b4005fd0 tx=0x7f20b402a8d0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 -- 172.21.15.104:0/598552062 shutdown_connections 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 --2- 172.21.15.104:0/598552062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4155af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 -- 172.21.15.104:0/598552062 >> 172.21.15.104:0/598552062 conn(0x7f20c40cd870 msgr2=0x7f20c4073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 -- 172.21.15.104:0/598552062 shutdown_connections 2024-09-17T04:11:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.182+0000 7f20cae07640 1 -- 172.21.15.104:0/598552062 wait complete. 2024-09-17T04:11:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.184+0000 7f20cae07640 1 Processor -- start 2024-09-17T04:11:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.184+0000 7f20cae07640 1 -- start start 2024-09-17T04:11:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c4156060 0x7f20c406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:46.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4071910 con 0x7f20c415efb0 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4071790 con 0x7f20c4073d90 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f20c4071a90 con 0x7f20c4156060 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33096/0 (socket says 172.21.15.104:33096) 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 -- 172.21.15.104:0/2414586748 learned_addr learned my addr 172.21.15.104:0/2414586748 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c93a4640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c4156060 0x7f20c406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c8ba3640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 -- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c4156060 msgr2=0x7f20c406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c4156060 0x7f20c406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 -- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 msgr2=0x7f20c4152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 -- 172.21.15.104:0/2414586748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c41567d0 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c3fff640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c500 tx=0x7f20ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac016020 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20ac012920 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c4156ab0 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac012d30 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.186+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c4158760 con 0x7f20c415efb0 2024-09-17T04:11:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.188+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c4156540 con 0x7f20c415efb0 2024-09-17T04:11:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.188+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20ac019020 con 0x7f20c415efb0 2024-09-17T04:11:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.189+0000 7f20c17fa640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 0x7f20a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.189+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f20ac09af80 con 0x7f20c415efb0 2024-09-17T04:11:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.189+0000 7f20c8ba3640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 0x7f20a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.189+0000 7f20c8ba3640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 0x7f20a407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20b4034000 tx=0x7f20b4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:46.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.193+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20ac020030 con 0x7f20c415efb0 2024-09-17T04:11:46.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.370+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20c4071ef0 con 0x7f20c415efb0 2024-09-17T04:11:46.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.371+0000 7f20c17fa640 1 -- 172.21.15.104:0/2414586748 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18998 (secure 0 0 0) 0x7f20ac062fd0 con 0x7f20c415efb0 2024-09-17T04:11:46.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:11:46.371 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:10:20.513595+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:11:46.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 msgr2=0x7f20a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 0x7f20a407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20b4034000 tx=0x7f20b4004ab0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 msgr2=0x7f20c406dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:46.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c500 tx=0x7f20ac00c9c0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 shutdown_connections 2024-09-17T04:11:46.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f20a4078bc0 0x7f20a407b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c4156060 0x7f20c406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20c415efb0 0x7f20c406dac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 --2- 172.21.15.104:0/2414586748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c4073d90 0x7f20c4152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:46.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 >> 172.21.15.104:0/2414586748 conn(0x7f20c40cd870 msgr2=0x7f20c40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:46.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 shutdown_connections 2024-09-17T04:11:46.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:46.373+0000 7f20cae07640 1 -- 172.21.15.104:0/2414586748 wait complete. 2024-09-17T04:11:47.385 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T04:11:47.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:47.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.515+0000 7f05a64bd640 1 -- 172.21.15.104:0/4078162485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a00b64a0 msgr2=0x7f05a01626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.515+0000 7f05a64bd640 1 --2- 172.21.15.104:0/4078162485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a00b64a0 0x7f05a01626d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f05a008ca50 tx=0x7f059402a560 comp rx=0 tx=0).stop 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.515+0000 7f05a64bd640 1 -- 172.21.15.104:0/4078162485 shutdown_connections 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.515+0000 7f05a64bd640 1 --2- 172.21.15.104:0/4078162485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a00b64a0 0x7f05a01626d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.515+0000 7f05a64bd640 1 --2- 172.21.15.104:0/4078162485 >> v2:172.21.15.192:3300/0 conn(0x7f05a015e7d0 0x7f05a00b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.516+0000 7f05a64bd640 1 -- 172.21.15.104:0/4078162485 >> 172.21.15.104:0/4078162485 conn(0x7f05a00d44e0 msgr2=0x7f05a00d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.516+0000 7f05a64bd640 1 -- 172.21.15.104:0/4078162485 shutdown_connections 2024-09-17T04:11:47.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.516+0000 7f05a64bd640 1 -- 172.21.15.104:0/4078162485 wait complete. 2024-09-17T04:11:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.517+0000 7f05a64bd640 1 Processor -- start 2024-09-17T04:11:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.518+0000 7f05a64bd640 1 -- start start 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a00b64a0 0x7f05a00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 0x7f05a014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05a0162c10 0x7f05a00cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f05a01631a0 con 0x7f05a015e7d0 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0163020 con 0x7f05a00b64a0 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a64bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f05a006ea10 con 0x7f05a0162c10 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 0x7f05a014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 0x7f05a014b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44276/0 (socket says 172.21.15.104:44276) 2024-09-17T04:11:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 -- 172.21.15.104:0/2128064793 learned_addr learned my addr 172.21.15.104:0/2128064793 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059ffff640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a00b64a0 0x7f05a00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f05a4a5a640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05a0162c10 0x7f05a00cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 -- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05a0162c10 msgr2=0x7f05a00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05a0162c10 0x7f05a00cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 -- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a00b64a0 msgr2=0x7f05a00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a00b64a0 0x7f05a00cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a00cb2e0 con 0x7f05a015e7d0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.519+0000 7f059f7fe640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 0x7f05a014b530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.520+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059403e030 con 0x7f05a015e7d0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.520+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0594003e00 con 0x7f05a015e7d0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.520+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a014c150 con 0x7f05a015e7d0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.520+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594035040 con 0x7f05a015e7d0 2024-09-17T04:11:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.520+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a0149580 con 0x7f05a015e7d0 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.521+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05a0149c40 con 0x7f05a015e7d0 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0594041030 con 0x7f05a015e7d0 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f058c078bc0 0x7f058c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f05940bbe20 con 0x7f05a015e7d0 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059ffff640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f058c078bc0 0x7f058c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f058c082630 0x7f058c084b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f059403be50 con 0x7f058c082630 2024-09-17T04:11:47.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f05940bc2b0 con 0x7f05a015e7d0 2024-09-17T04:11:47.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.522+0000 7f05a4a5a640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f058c082630 0x7f058c084b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.523+0000 7f05a4a5a640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f058c082630 0x7f058c084b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.523+0000 7f059ffff640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f058c078bc0 0x7f058c07b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f059000bb50 tx=0x7f059000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.523+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== osd.0 v2:172.21.15.104:6808/1713196558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f059403be50 con 0x7f058c082630 2024-09-17T04:11:47.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 --> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f05a014bf00 con 0x7f058c082630 2024-09-17T04:11:47.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f059cff9640 1 -- 172.21.15.104:0/2128064793 <== osd.0 v2:172.21.15.104:6808/1713196558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f05a014bf00 con 0x7f058c082630 2024-09-17T04:11:47.536 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:47.536 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:47.536 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f058c082630 msgr2=0x7f058c084b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:6808/1713196558,v1:172.21.15.104:6809/1713196558] conn(0x7f058c082630 0x7f058c084b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f058c078bc0 msgr2=0x7f058c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f058c078bc0 0x7f058c07b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f059000bb50 tx=0x7f059000b2e0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 msgr2=0x7f05a014b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 --2- 172.21.15.104:0/2128064793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05a015e7d0 0x7f05a014b530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0594000c00 tx=0x7f0594003910 comp rx=0 tx=0).stop 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a4a5a640 1 -- 172.21.15.104:0/2128064793 reap_dead start 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 shutdown_connections 2024-09-17T04:11:47.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 >> 172.21.15.104:0/2128064793 conn(0x7f05a00d44e0 msgr2=0x7f05a00d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 shutdown_connections 2024-09-17T04:11:47.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.536+0000 7f05a64bd640 1 -- 172.21.15.104:0/2128064793 wait complete. 2024-09-17T04:11:47.547 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 -- 172.21.15.104:0/3106165157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 msgr2=0x7f5c900cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 --2- 172.21.15.104:0/3106165157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900cefa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c88005fd0 tx=0x7f5c8802a980 comp rx=0 tx=0).stop 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 -- 172.21.15.104:0/3106165157 shutdown_connections 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 --2- 172.21.15.104:0/3106165157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900cefa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 -- 172.21.15.104:0/3106165157 >> 172.21.15.104:0/3106165157 conn(0x7f5c9009d830 msgr2=0x7f5c900b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 -- 172.21.15.104:0/3106165157 shutdown_connections 2024-09-17T04:11:47.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.660+0000 7f5c98430640 1 -- 172.21.15.104:0/3106165157 wait complete. 2024-09-17T04:11:47.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.661+0000 7f5c98430640 1 Processor -- start 2024-09-17T04:11:47.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.661+0000 7f5c98430640 1 -- start start 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 0x7f5c900d4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c9015ee80 0x7f5c900cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900b6910 con 0x7f5c900ceb90 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900b6790 con 0x7f5c900d0170 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c98430640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c900b6a90 con 0x7f5c9015ee80 2024-09-17T04:11:47.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44284/0 (socket says 172.21.15.104:44284) 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 -- 172.21.15.104:0/2579403593 learned_addr learned my addr 172.21.15.104:0/2579403593 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c959cb640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 0x7f5c900d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c969cd640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c9015ee80 0x7f5c900cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 -- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c9015ee80 msgr2=0x7f5c900cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c9015ee80 0x7f5c900cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 -- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 msgr2=0x7f5c900d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 0x7f5c900d4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 -- 172.21.15.104:0/2579403593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9006e8f0 con 0x7f5c900ceb90 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c959cb640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 0x7f5c900d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c961cc640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00c3c0 tx=0x7f5c8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c017070 con 0x7f5c900ceb90 2024-09-17T04:11:47.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.663+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c8c0035f0 con 0x7f5c900ceb90 2024-09-17T04:11:47.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.664+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c003a80 con 0x7f5c900ceb90 2024-09-17T04:11:47.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.664+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9006ebd0 con 0x7f5c900ceb90 2024-09-17T04:11:47.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.664+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9006f190 con 0x7f5c900ceb90 2024-09-17T04:11:47.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.665+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c900cefa0 con 0x7f5c900ceb90 2024-09-17T04:11:47.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.665+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c8c01a070 con 0x7f5c900ceb90 2024-09-17T04:11:47.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.666+0000 7f5c86ffd640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 0x7f5c7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.666+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f5c8c09a490 con 0x7f5c900ceb90 2024-09-17T04:11:47.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.666+0000 7f5c959cb640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 0x7f5c7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.667+0000 7f5c959cb640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 0x7f5c7407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c900b2eb0 tx=0x7f5c80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.670+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c901592d0 con 0x7f5c900ceb90 2024-09-17T04:11:47.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.846+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5c900b3610 con 0x7f5c74078b90 2024-09-17T04:11:47.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.847+0000 7f5c86ffd640 1 -- 172.21.15.104:0/2579403593 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c900b3610 con 0x7f5c74078b90 2024-09-17T04:11:47.846 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T04:11:47.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 msgr2=0x7f5c7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 0x7f5c7407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5c900b2eb0 tx=0x7f5c80008040 comp rx=0 tx=0).stop 2024-09-17T04:11:47.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 msgr2=0x7f5c900d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00c3c0 tx=0x7f5c8c00c880 comp rx=0 tx=0).stop 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 shutdown_connections 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f5c74078b90 0x7f5c7407b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c900d0170 0x7f5c900d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c9015ee80 0x7f5c900cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 --2- 172.21.15.104:0/2579403593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c900ceb90 0x7f5c900d4200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 >> 172.21.15.104:0/2579403593 conn(0x7f5c9009d830 msgr2=0x7f5c9015ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 shutdown_connections 2024-09-17T04:11:47.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.849+0000 7f5c98430640 1 -- 172.21.15.104:0/2579403593 wait complete. 2024-09-17T04:11:47.860 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T04:11:47.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:47.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 -- 172.21.15.104:0/234702178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feee0004800 msgr2=0x7feee0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 --2- 172.21.15.104:0/234702178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feee0004800 0x7feee0004c10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feee400c260 tx=0x7feee0005830 comp rx=0 tx=0).stop 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 -- 172.21.15.104:0/234702178 shutdown_connections 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 --2- 172.21.15.104:0/234702178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feee0004800 0x7feee0004c10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 -- 172.21.15.104:0/234702178 >> 172.21.15.104:0/234702178 conn(0x7feef40d22e0 msgr2=0x7feef40d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 -- 172.21.15.104:0/234702178 shutdown_connections 2024-09-17T04:11:47.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.976+0000 7feefbd21640 1 -- 172.21.15.104:0/234702178 wait complete. 2024-09-17T04:11:47.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.978+0000 7feefbd21640 1 Processor -- start 2024-09-17T04:11:47.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.978+0000 7feefbd21640 1 -- start start 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.979+0000 7feefbd21640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee0004800 0x7feef4142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.979+0000 7feefbd21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 0x7feef41f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.979+0000 7feefbd21640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feef413f330 0x7feef413f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefbd21640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feef415ce90 con 0x7feef41f7030 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefbd21640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feef415cd10 con 0x7feee0004800 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefbd21640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feef40d1200 con 0x7feef413f330 2024-09-17T04:11:47.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 0x7feef41f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 0x7feef41f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44306/0 (socket says 172.21.15.104:44306) 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 -- 172.21.15.104:0/58235762 learned_addr learned my addr 172.21.15.104:0/58235762 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 -- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feef413f330 msgr2=0x7feef413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefa2be640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feef413f330 0x7feef413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef9abd640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee0004800 0x7feef4142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feef413f330 0x7feef413f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 -- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee0004800 msgr2=0x7feef4142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee0004800 0x7feef4142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef413fc80 con 0x7feef41f7030 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefa2be640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feef413f330 0x7feef413f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef9abd640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee0004800 0x7feef4142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:47.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feef92bc640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 0x7feef41f7440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feee400c350 tx=0x7feee4001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4031040 con 0x7feef41f7030 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feee4003800 con 0x7feef41f7030 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef41f3590 con 0x7feef41f7030 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4003c30 con 0x7feef41f7030 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.980+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef41f3b50 con 0x7feef41f7030 2024-09-17T04:11:47.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.981+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feef41600f0 con 0x7feef41f7030 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.982+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feee4034070 con 0x7feef41f7030 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.982+0000 7feeea7fc640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.982+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7feee40bb140 con 0x7feef41f7030 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feeea7fc640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7feed8082600 0x7feed8084af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feef9abd640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feee4006290 con 0x7feed8082600 2024-09-17T04:11:47.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feee40c2050 con 0x7feef41f7030 2024-09-17T04:11:47.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feefa2be640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7feed8082600 0x7feed8084af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:47.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feefa2be640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7feed8082600 0x7feed8084af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.983+0000 7feef9abd640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feef0009bc0 tx=0x7feef0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:47.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.984+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== osd.1 v2:172.21.15.104:6800/2753114801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feee4006290 con 0x7feed8082600 2024-09-17T04:11:47.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.996+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 --> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feef4071f00 con 0x7feed8082600 2024-09-17T04:11:47.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.996+0000 7feeea7fc640 1 -- 172.21.15.104:0/58235762 <== osd.1 v2:172.21.15.104:6800/2753114801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feef4071f00 con 0x7feed8082600 2024-09-17T04:11:47.996 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:47.996 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:47.996 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:47.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.996+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7feed8082600 msgr2=0x7feed8084af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.996+0000 7feefbd21640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:6800/2753114801,v1:172.21.15.104:6801/2753114801] conn(0x7feed8082600 0x7feed8084af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feed8078b90 msgr2=0x7feed807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feef0009bc0 tx=0x7feef0005f90 comp rx=0 tx=0).stop 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 msgr2=0x7feef41f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 --2- 172.21.15.104:0/58235762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feef41f7030 0x7feef41f7440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feee400c350 tx=0x7feee4001dd0 comp rx=0 tx=0).stop 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefa2be640 1 -- 172.21.15.104:0/58235762 reap_dead start 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 shutdown_connections 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 >> 172.21.15.104:0/58235762 conn(0x7feef40d22e0 msgr2=0x7feef4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 shutdown_connections 2024-09-17T04:11:47.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:47.997+0000 7feefbd21640 1 -- 172.21.15.104:0/58235762 wait complete. 2024-09-17T04:11:48.007 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T04:11:48.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 -- 172.21.15.104:0/1853563947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff80b5260 msgr2=0x7f3ff815ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/1853563947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff80b5260 0x7f3ff815ba80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3ff806e6e0 tx=0x7f3fe002a540 comp rx=0 tx=0).stop 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 -- 172.21.15.104:0/1853563947 shutdown_connections 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/1853563947 >> v2:172.21.15.192:3300/0 conn(0x7f3ff815bfc0 0x7f3ff815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/1853563947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff80b5260 0x7f3ff815ba80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/1853563947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff806def0 0x7f3ff806f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 -- 172.21.15.104:0/1853563947 >> 172.21.15.104:0/1853563947 conn(0x7f3ff80cdca0 msgr2=0x7f3ff80ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 -- 172.21.15.104:0/1853563947 shutdown_connections 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.120+0000 7f3ffeab6640 1 -- 172.21.15.104:0/1853563947 wait complete. 2024-09-17T04:11:48.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.122+0000 7f3ffeab6640 1 Processor -- start 2024-09-17T04:11:48.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.122+0000 7f3ffeab6640 1 -- start start 2024-09-17T04:11:48.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff806def0 0x7f3ff8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff80b5260 0x7f3ff80cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff815fcf0 con 0x7f3ff815bfc0 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff815fb70 con 0x7f3ff806def0 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.123+0000 7f3ffeab6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff815fe70 con 0x7f3ff80b5260 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44334/0 (socket says 172.21.15.104:44334) 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 -- 172.21.15.104:0/2605720212 learned_addr learned my addr 172.21.15.104:0/2605720212 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffc852640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff806def0 0x7f3ff8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ff7fff640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff80b5260 0x7f3ff80cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 -- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff80b5260 msgr2=0x7f3ff80cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff80b5260 0x7f3ff80cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 -- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff806def0 msgr2=0x7f3ff8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff806def0 0x7f3ff8156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 -- 172.21.15.104:0/2605720212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff81f8ea0 con 0x7f3ff815bfc0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffd053640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000d690 tx=0x7f3ff000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0017070 con 0x7f3ff815bfc0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ff0005310 con 0x7f3ff815bfc0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff81f9180 con 0x7f3ff815bfc0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0009820 con 0x7f3ff815bfc0 2024-09-17T04:11:48.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.124+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81f9740 con 0x7f3ff815bfc0 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.125+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff815ba80 con 0x7f3ff815bfc0 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.126+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ff00099c0 con 0x7f3ff815bfc0 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.126+0000 7f3ff57fa640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 0x7f3fd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.127+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3ff009b110 con 0x7f3ff815bfc0 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.127+0000 7f3ffc852640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 0x7f3fd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.127+0000 7f3ffc852640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 0x7f3fd807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ff815efd0 tx=0x7f3fe80095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.131+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ff0062b10 con 0x7f3ff815bfc0 2024-09-17T04:11:48.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.308+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3ff81f8c20 con 0x7f3fd8078b90 2024-09-17T04:11:48.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.309+0000 7f3ff57fa640 1 -- 172.21.15.104:0/2605720212 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3ff81f8c20 con 0x7f3fd8078b90 2024-09-17T04:11:48.309 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T04:11:48.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 msgr2=0x7f3fd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 0x7f3fd807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ff815efd0 tx=0x7f3fe80095e0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 msgr2=0x7f3ff806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000d690 tx=0x7f3ff000db50 comp rx=0 tx=0).stop 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 shutdown_connections 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3fd8078b90 0x7f3fd807b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ff815bfc0 0x7f3ff806cde0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff80b5260 0x7f3ff80cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 --2- 172.21.15.104:0/2605720212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff806def0 0x7f3ff8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 >> 172.21.15.104:0/2605720212 conn(0x7f3ff80cdca0 msgr2=0x7f3ff80ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 shutdown_connections 2024-09-17T04:11:48.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.311+0000 7f3ffeab6640 1 -- 172.21.15.104:0/2605720212 wait complete. 2024-09-17T04:11:48.322 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T04:11:48.322 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:48.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 -- 172.21.15.104:0/2448888208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5974003a50 msgr2=0x7f5974003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 --2- 172.21.15.104:0/2448888208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5974003a50 0x7f5974003ec0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5984006fc0 tx=0x7f5974005830 comp rx=0 tx=0).stop 2024-09-17T04:11:48.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 -- 172.21.15.104:0/2448888208 shutdown_connections 2024-09-17T04:11:48.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 --2- 172.21.15.104:0/2448888208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5974003a50 0x7f5974003ec0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 -- 172.21.15.104:0/2448888208 >> 172.21.15.104:0/2448888208 conn(0x7f59880d44e0 msgr2=0x7f59880d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 -- 172.21.15.104:0/2448888208 shutdown_connections 2024-09-17T04:11:48.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.441+0000 7f598f3f9640 1 -- 172.21.15.104:0/2448888208 wait complete. 2024-09-17T04:11:48.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.443+0000 7f598f3f9640 1 Processor -- start 2024-09-17T04:11:48.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.443+0000 7f598f3f9640 1 -- start start 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5974003a50 0x7f598815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 0x7f59880b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59880b9790 0x7f59880b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5988162b70 con 0x7f59880ce220 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59881629f0 con 0x7f5974003a50 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598f3f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f59880b5f60 con 0x7f59880b9790 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598c994640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 0x7f59880b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598c994640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 0x7f59880b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44346/0 (socket says 172.21.15.104:44346) 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.444+0000 7f598c994640 1 -- 172.21.15.104:0/244381509 learned_addr learned my addr 172.21.15.104:0/244381509 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598d996640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59880b9790 0x7f59880b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598d195640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5974003a50 0x7f598815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 -- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59880b9790 msgr2=0x7f59880b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59880b9790 0x7f59880b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 -- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5974003a50 msgr2=0x7f598815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5974003a50 0x7f598815b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59880b9ba0 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598d195640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5974003a50 0x7f598815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598d996640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59880b9790 0x7f59880b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598c994640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 0x7f59880b9250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5978003f50 tx=0x7f59780016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978015070 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5978011840 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59880cca40 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978011c70 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.445+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59880cd000 con 0x7f59880ce220 2024-09-17T04:11:48.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.446+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59880b64c0 con 0x7f59880ce220 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.447+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5978018070 con 0x7f59880ce220 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.447+0000 7f597dffb640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f596c078bc0 0x7f596c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f597809bfb0 con 0x7f59880ce220 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f598d195640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f596c078bc0 0x7f596c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f597dffb640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7f596c082620 0x7f596c084b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f596c0851e0 con 0x7f596c082620 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f597809c440 con 0x7f59880ce220 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f598d996640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7f596c082620 0x7f596c084b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f598d996640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7f596c082620 0x7f596c084b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.448+0000 7f598d195640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f596c078bc0 0x7f596c07b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5984033000 tx=0x7f5984000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.449+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== osd.2 v2:172.21.15.104:6816/812544585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f596c0851e0 con 0x7f596c082620 2024-09-17T04:11:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.461+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 --> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59880cc7f0 con 0x7f596c082620 2024-09-17T04:11:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.461+0000 7f597dffb640 1 -- 172.21.15.104:0/244381509 <== osd.2 v2:172.21.15.104:6816/812544585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f59880cc7f0 con 0x7f596c082620 2024-09-17T04:11:48.461 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:48.461 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:48.462 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:48.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7f596c082620 msgr2=0x7f596c084b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:6816/812544585,v1:172.21.15.104:6817/812544585] conn(0x7f596c082620 0x7f596c084b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f596c078bc0 msgr2=0x7f596c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f596c078bc0 0x7f596c07b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5984033000 tx=0x7f5984000fe0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 msgr2=0x7f59880b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 --2- 172.21.15.104:0/244381509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f59880ce220 0x7f59880b9250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5978003f50 tx=0x7f59780016f0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598d996640 1 -- 172.21.15.104:0/244381509 reap_dead start 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 shutdown_connections 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 >> 172.21.15.104:0/244381509 conn(0x7f59880d44e0 msgr2=0x7f59880b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 shutdown_connections 2024-09-17T04:11:48.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.462+0000 7f598f3f9640 1 -- 172.21.15.104:0/244381509 wait complete. 2024-09-17T04:11:48.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 -- 172.21.15.104:0/3315785069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41e4004d40 msgr2=0x7f41e40051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 --2- 172.21.15.104:0/3315785069 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41e4004d40 0x7f41e40051f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41f40013d0 tx=0x7f41e4005830 comp rx=0 tx=0).stop 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f42009ea640 1 -- 172.21.15.104:0/3315785069 reap_dead start 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 -- 172.21.15.104:0/3315785069 shutdown_connections 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 -- 172.21.15.104:0/3315785069 >> 172.21.15.104:0/3315785069 conn(0x7f41fc0b46e0 msgr2=0x7f41fc0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 -- 172.21.15.104:0/3315785069 shutdown_connections 2024-09-17T04:11:48.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.586+0000 7f420244d640 1 -- 172.21.15.104:0/3315785069 wait complete. 2024-09-17T04:11:48.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.588+0000 7f420244d640 1 Processor -- start 2024-09-17T04:11:48.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.588+0000 7f420244d640 1 -- start start 2024-09-17T04:11:48.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41fc157e20 0x7f41fc15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41fc154e70 0x7f41fc155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0b62f0 con 0x7f41fc1f37e0 2024-09-17T04:11:48.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc15ce00 con 0x7f41fc154e70 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.589+0000 7f420244d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc0b6470 con 0x7f41fc157e20 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41fc157e20 0x7f41fc15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44360/0 (socket says 172.21.15.104:44360) 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 -- 172.21.15.104:0/1841668121 learned_addr learned my addr 172.21.15.104:0/1841668121 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f42009ea640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41fc154e70 0x7f41fc155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 -- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41fc157e20 msgr2=0x7f41fc15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41fc157e20 0x7f41fc15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 -- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41fc154e70 msgr2=0x7f41fc155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41fc154e70 0x7f41fc155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 -- 172.21.15.104:0/1841668121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc158230 con 0x7f41fc1f37e0 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41fb7fe640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41f0004e80 tx=0x7f41f0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0015020 con 0x7f41fc1f37e0 2024-09-17T04:11:48.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc1557c0 con 0x7f41fc1f37e0 2024-09-17T04:11:48.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41f0011980 con 0x7f41fc1f37e0 2024-09-17T04:11:48.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0011dd0 con 0x7f41fc1f37e0 2024-09-17T04:11:48.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.590+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc156b50 con 0x7f41fc1f37e0 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.591+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc0ce210 con 0x7f41fc1f37e0 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.592+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41f0018020 con 0x7f41fc1f37e0 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.592+0000 7f41f8ff9640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.593+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f41f009b7a0 con 0x7f41fc1f37e0 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.593+0000 7f41fbfff640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.593+0000 7f41fbfff640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 0x7f41e807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0b1b90 tx=0x7f41ec005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.597+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41fc0ce210 con 0x7f41fc1f37e0 2024-09-17T04:11:48.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.775+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f41fc0b5be0 con 0x7f41e8078b90 2024-09-17T04:11:48.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.775+0000 7f41f8ff9640 1 -- 172.21.15.104:0/1841668121 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41fc0b5be0 con 0x7f41e8078b90 2024-09-17T04:11:48.775 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 msgr2=0x7f41e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 0x7f41e807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0b1b90 tx=0x7f41ec005f90 comp rx=0 tx=0).stop 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 msgr2=0x7f41fc1f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41f0004e80 tx=0x7f41f0001630 comp rx=0 tx=0).stop 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 shutdown_connections 2024-09-17T04:11:48.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41fc154e70 0x7f41fc155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc1f37e0 0x7f41fc1f3bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 --2- 172.21.15.104:0/1841668121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41fc157e20 0x7f41fc15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 >> 172.21.15.104:0/1841668121 conn(0x7f41fc0b46e0 msgr2=0x7f41fc155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 shutdown_connections 2024-09-17T04:11:48.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.778+0000 7f420244d640 1 -- 172.21.15.104:0/1841668121 wait complete. 2024-09-17T04:11:48.789 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T04:11:48.789 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:48.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 -- 172.21.15.104:0/1295085324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 msgr2=0x7f095c0adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 --2- 172.21.15.104:0/1295085324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c0adfe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0954005fd0 tx=0x7f095402a4a0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 -- 172.21.15.104:0/1295085324 shutdown_connections 2024-09-17T04:11:48.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 --2- 172.21.15.104:0/1295085324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c0adfe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 --2- 172.21.15.104:0/1295085324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f095c0d1b60 0x7f095c0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 -- 172.21.15.104:0/1295085324 >> 172.21.15.104:0/1295085324 conn(0x7f095c09a9e0 msgr2=0x7f095c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 -- 172.21.15.104:0/1295085324 shutdown_connections 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.905+0000 7f0962e69640 1 -- 172.21.15.104:0/1295085324 wait complete. 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.907+0000 7f0962e69640 1 Processor -- start 2024-09-17T04:11:48.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.907+0000 7f0962e69640 1 -- start start 2024-09-17T04:11:48.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f095c06f5f0 0x7f095c15e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c09eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c0d1b60 0x7f095c0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0b6cd0 con 0x7f095c0cd240 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0b6b50 con 0x7f095c0d1b60 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f0962e69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f095c0ae520 con 0x7f095c06f5f0 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.908+0000 7f095bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c09eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c09eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44392/0 (socket says 172.21.15.104:44392) 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 -- 172.21.15.104:0/2050902239 learned_addr learned my addr 172.21.15.104:0/2050902239 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f0961406640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c0d1b60 0x7f095c0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f0960c05640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f095c06f5f0 0x7f095c15e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 -- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f095c06f5f0 msgr2=0x7f095c15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f095c06f5f0 0x7f095c15e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 -- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c0d1b60 msgr2=0x7f095c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c0d1b60 0x7f095c0c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c0cafa0 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f095bfff640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c09eb60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f094400b440 tx=0x7f094400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944015020 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0944011980 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944011dd0 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c0cb280 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.909+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c1f7230 con 0x7f095c0cd240 2024-09-17T04:11:48.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.910+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f095c1f7040 con 0x7f095c0cd240 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.911+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0944018020 con 0x7f095c0cd240 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.911+0000 7f09597fa640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f093c078b90 0x7f093c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f094409b920 con 0x7f095c0cd240 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f09597fa640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f093c082580 0x7f093c084a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f0960c05640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f093c078b90 0x7f093c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0944019e70 con 0x7f093c082580 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f094409bdb0 con 0x7f095c0cd240 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f0961406640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f093c082580 0x7f093c084a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f0961406640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f093c082580 0x7f093c084a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.912+0000 7f0960c05640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f093c078b90 0x7f093c07b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f094c009f60 tx=0x7f094c0094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:48.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.913+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== osd.3 v2:172.21.15.104:6824/966144578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0944019e70 con 0x7f093c082580 2024-09-17T04:11:48.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.925+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 --> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f095c0aea50 con 0x7f093c082580 2024-09-17T04:11:48.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.925+0000 7f09597fa640 1 -- 172.21.15.104:0/2050902239 <== osd.3 v2:172.21.15.104:6824/966144578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f095c0aea50 con 0x7f093c082580 2024-09-17T04:11:48.925 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:48.925 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:48.925 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:48.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.925+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f093c082580 msgr2=0x7f093c084a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.925+0000 7f0962e69640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:6824/966144578,v1:172.21.15.104:6825/966144578] conn(0x7f093c082580 0x7f093c084a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f093c078b90 msgr2=0x7f093c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f093c078b90 0x7f093c07b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f094c009f60 tx=0x7f094c0094f0 comp rx=0 tx=0).stop 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 msgr2=0x7f095c09eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 --2- 172.21.15.104:0/2050902239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f095c0cd240 0x7f095c09eb60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f094400b440 tx=0x7f094400b900 comp rx=0 tx=0).stop 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0961406640 1 -- 172.21.15.104:0/2050902239 reap_dead start 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 shutdown_connections 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 >> 172.21.15.104:0/2050902239 conn(0x7f095c09a9e0 msgr2=0x7f095c070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 shutdown_connections 2024-09-17T04:11:48.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:48.926+0000 7f0962e69640 1 -- 172.21.15.104:0/2050902239 wait complete. 2024-09-17T04:11:48.936 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T04:11:49.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 -- 172.21.15.104:0/3474082451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280aeeb0 msgr2=0x7f92280b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 --2- 172.21.15.104:0/3474082451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280aeeb0 0x7f92280b2ca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9218009830 tx=0x7f921802a380 comp rx=0 tx=0).stop 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 -- 172.21.15.104:0/3474082451 shutdown_connections 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 --2- 172.21.15.104:0/3474082451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280aeeb0 0x7f92280b2ca0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 --2- 172.21.15.104:0/3474082451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922815c750 0x7f92280ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 -- 172.21.15.104:0/3474082451 >> 172.21.15.104:0/3474082451 conn(0x7f92280cdca0 msgr2=0x7f92280ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 -- 172.21.15.104:0/3474082451 shutdown_connections 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.049+0000 7f922e92b640 1 -- 172.21.15.104:0/3474082451 wait complete. 2024-09-17T04:11:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.051+0000 7f922e92b640 1 Processor -- start 2024-09-17T04:11:49.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.051+0000 7f922e92b640 1 -- start start 2024-09-17T04:11:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92280aeeb0 0x7f922814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922815c750 0x7f92281f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f92280745b0 con 0x7f92280b31e0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f922815cc70 con 0x7f92280aeeb0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.052+0000 7f922e92b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9228074730 con 0x7f922815c750 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44404/0 (socket says 172.21.15.104:44404) 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 -- 172.21.15.104:0/2031845256 learned_addr learned my addr 172.21.15.104:0/2031845256 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 -- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922815c750 msgr2=0x7f92281f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922815c750 0x7f92281f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 -- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92280aeeb0 msgr2=0x7f922814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92280aeeb0 0x7f922814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 -- 172.21.15.104:0/2031845256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92280d0270 con 0x7f92280b31e0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f92277fe640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9218009780 tx=0x7f9218033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921803f020 con 0x7f92280b31e0 2024-09-17T04:11:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9218033e10 con 0x7f92280b31e0 2024-09-17T04:11:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218037040 con 0x7f92280b31e0 2024-09-17T04:11:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92280d0550 con 0x7f92280b31e0 2024-09-17T04:11:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.053+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922815fa30 con 0x7f92280b31e0 2024-09-17T04:11:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.054+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92280d0790 con 0x7f92280b31e0 2024-09-17T04:11:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.055+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9218042020 con 0x7f92280b31e0 2024-09-17T04:11:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.055+0000 7f9224ff9640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 0x7f920807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.056+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f92180bb130 con 0x7f92280b31e0 2024-09-17T04:11:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.056+0000 7f9227fff640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 0x7f920807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.056+0000 7f9227fff640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 0x7f920807b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92100058c0 tx=0x7f9210005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.060+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9218049030 con 0x7f92280b31e0 2024-09-17T04:11:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.233+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9228074c50 con 0x7f9208078b90 2024-09-17T04:11:49.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.234+0000 7f9224ff9640 1 -- 172.21.15.104:0/2031845256 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9228074c50 con 0x7f9208078b90 2024-09-17T04:11:49.234 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T04:11:49.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 msgr2=0x7f920807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 0x7f920807b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92100058c0 tx=0x7f9210005850 comp rx=0 tx=0).stop 2024-09-17T04:11:49.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 msgr2=0x7f922814e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9218009780 tx=0x7f9218033c20 comp rx=0 tx=0).stop 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 shutdown_connections 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f9208078b90 0x7f920807b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f922815c750 0x7f92281f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92280b31e0 0x7f922814e630 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 --2- 172.21.15.104:0/2031845256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92280aeeb0 0x7f922814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 >> 172.21.15.104:0/2031845256 conn(0x7f92280cdca0 msgr2=0x7f92280b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 shutdown_connections 2024-09-17T04:11:49.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.236+0000 7f922e92b640 1 -- 172.21.15.104:0/2031845256 wait complete. 2024-09-17T04:11:49.247 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T04:11:49.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 -- 172.21.15.104:0/783549663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b68004d40 msgr2=0x7f1b68005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 --2- 172.21.15.104:0/783549663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b68004d40 0x7f1b68005150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009b20 tx=0x7f1b68005830 comp rx=0 tx=0).stop 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b855af640 1 -- 172.21.15.104:0/783549663 reap_dead start 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 -- 172.21.15.104:0/783549663 shutdown_connections 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 -- 172.21.15.104:0/783549663 >> 172.21.15.104:0/783549663 conn(0x7f1b800d4510 msgr2=0x7f1b800d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 -- 172.21.15.104:0/783549663 shutdown_connections 2024-09-17T04:11:49.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.365+0000 7f1b87012640 1 -- 172.21.15.104:0/783549663 wait complete. 2024-09-17T04:11:49.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.366+0000 7f1b87012640 1 Processor -- start 2024-09-17T04:11:49.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.366+0000 7f1b87012640 1 -- start start 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8015ab60 0x7f1b8015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b801f9130 0x7f1b801f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 0x7f1b801f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800b83e0 con 0x7f1b801f5b40 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800b8260 con 0x7f1b8015ab60 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b87012640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1b80162600 con 0x7f1b801f9130 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 0x7f1b801f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 0x7f1b801f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44418/0 (socket says 172.21.15.104:44418) 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 -- 172.21.15.104:0/2122680640 learned_addr learned my addr 172.21.15.104:0/2122680640 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b84dae640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8015ab60 0x7f1b8015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b7ffff640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b801f9130 0x7f1b801f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 -- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b801f9130 msgr2=0x7f1b801f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b801f9130 0x7f1b801f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 -- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8015ab60 msgr2=0x7f1b8015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8015ab60 0x7f1b8015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.368+0000 7f1b855af640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b801f9a80 con 0x7f1b801f5b40 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b855af640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 0x7f1b801f5f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009b20 tx=0x7f1b78033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78038040 con 0x7f1b801f5b40 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b7802b7b0 con 0x7f1b801f5b40 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78009720 con 0x7f1b801f5b40 2024-09-17T04:11:49.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8014c450 con 0x7f1b801f5b40 2024-09-17T04:11:49.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.369+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8015e650 con 0x7f1b801f5b40 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.370+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b80161ed0 con 0x7f1b801f5b40 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b78044030 con 0x7f1b801f5b40 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1b780bbc30 con 0x7f1b801f5b40 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f1b6c0825f0 0x7f1b6c084ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b7804be50 con 0x7f1b6c0825f0 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1b780bc0c0 con 0x7f1b801f5b40 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.371+0000 7f1b84dae640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.372+0000 7f1b7ffff640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f1b6c0825f0 0x7f1b6c084ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.372+0000 7f1b84dae640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b801ecc10 tx=0x7f1b70005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.372+0000 7f1b7ffff640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f1b6c0825f0 0x7f1b6c084ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.373+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== osd.4 v2:172.21.15.192:6826/4212015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b7804be50 con 0x7f1b6c0825f0 2024-09-17T04:11:49.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.385+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 --> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b800cfe20 con 0x7f1b6c0825f0 2024-09-17T04:11:49.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b7d7fa640 1 -- 172.21.15.104:0/2122680640 <== osd.4 v2:172.21.15.192:6826/4212015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b800cfe20 con 0x7f1b6c0825f0 2024-09-17T04:11:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:49.386 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:49.386 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:49.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f1b6c0825f0 msgr2=0x7f1b6c084ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6826/4212015,v1:172.21.15.192:6827/4212015] conn(0x7f1b6c0825f0 0x7f1b6c084ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1b6c078b90 msgr2=0x7f1b6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b801ecc10 tx=0x7f1b70005f90 comp rx=0 tx=0).stop 2024-09-17T04:11:49.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 msgr2=0x7f1b801f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 --2- 172.21.15.104:0/2122680640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b801f5b40 0x7f1b801f5f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009b20 tx=0x7f1b78033670 comp rx=0 tx=0).stop 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b855af640 1 -- 172.21.15.104:0/2122680640 reap_dead start 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 shutdown_connections 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.386+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 >> 172.21.15.104:0/2122680640 conn(0x7f1b800d4510 msgr2=0x7f1b800b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.387+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 shutdown_connections 2024-09-17T04:11:49.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.387+0000 7f1b87012640 1 -- 172.21.15.104:0/2122680640 wait complete. 2024-09-17T04:11:49.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 -- 172.21.15.104:0/2531264417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 msgr2=0x7f44c415f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 --2- 172.21.15.104:0/2531264417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c415f630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44bc005fd0 tx=0x7f44bc02a8b0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 -- 172.21.15.104:0/2531264417 shutdown_connections 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 --2- 172.21.15.104:0/2531264417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c415f630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 -- 172.21.15.104:0/2531264417 >> 172.21.15.104:0/2531264417 conn(0x7f44c40cdca0 msgr2=0x7f44c40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 -- 172.21.15.104:0/2531264417 shutdown_connections 2024-09-17T04:11:49.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.510+0000 7f44cbde6640 1 -- 172.21.15.104:0/2531264417 wait complete. 2024-09-17T04:11:49.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.511+0000 7f44cbde6640 1 Processor -- start 2024-09-17T04:11:49.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.512+0000 7f44cbde6640 1 -- start start 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44c406def0 0x7f44c41f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44c40b5260 0x7f44c406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4071300 con 0x7f44c40b5670 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4071480 con 0x7f44c40b5260 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44cbde6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f44c4071600 con 0x7f44c406def0 2024-09-17T04:11:49.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44444/0 (socket says 172.21.15.104:44444) 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 -- 172.21.15.104:0/1919885017 learned_addr learned my addr 172.21.15.104:0/1919885017 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44c9381640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44c40b5260 0x7f44c406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44c9b82640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44c406def0 0x7f44c41f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 -- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44c406def0 msgr2=0x7f44c41f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44c406def0 0x7f44c41f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 -- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44c40b5260 msgr2=0x7f44c406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44c40b5260 0x7f44c406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 -- 172.21.15.104:0/1919885017 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c41f34b0 con 0x7f44c40b5670 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.513+0000 7f44ca383640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009cd0 tx=0x7f44bc0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.514+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc031990 con 0x7f44c40b5670 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.514+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44bc031c20 con 0x7f44c40b5670 2024-09-17T04:11:49.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.514+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0332f0 con 0x7f44c40b5670 2024-09-17T04:11:49.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.514+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c4158ee0 con 0x7f44c40b5670 2024-09-17T04:11:49.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.514+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c41f3a50 con 0x7f44c40b5670 2024-09-17T04:11:49.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.515+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c4071b30 con 0x7f44c40b5670 2024-09-17T04:11:49.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.515+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44bc033490 con 0x7f44c40b5670 2024-09-17T04:11:49.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.516+0000 7f44ba7fc640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 0x7f44a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.516+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f44bc0bc660 con 0x7f44c40b5670 2024-09-17T04:11:49.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.516+0000 7f44c9b82640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 0x7f44a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.516+0000 7f44c9b82640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 0x7f44a807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000f60 tx=0x7f44c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.520+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44bc03f030 con 0x7f44c40b5670 2024-09-17T04:11:49.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.697+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f44c40ae5a0 con 0x7f44a8078b90 2024-09-17T04:11:49.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.697+0000 7f44ba7fc640 1 -- 172.21.15.104:0/1919885017 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44c40ae5a0 con 0x7f44a8078b90 2024-09-17T04:11:49.697 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 msgr2=0x7f44a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 0x7f44a807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44c0000f60 tx=0x7f44c0009040 comp rx=0 tx=0).stop 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 msgr2=0x7f44c409dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009cd0 tx=0x7f44bc0039f0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 shutdown_connections 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f44a8078b90 0x7f44a807b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44c40b5260 0x7f44c406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44c40b5670 0x7f44c409dec0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 --2- 172.21.15.104:0/1919885017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44c406def0 0x7f44c41f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 >> 172.21.15.104:0/1919885017 conn(0x7f44c40cdca0 msgr2=0x7f44c40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 shutdown_connections 2024-09-17T04:11:49.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.700+0000 7f44cbde6640 1 -- 172.21.15.104:0/1919885017 wait complete. 2024-09-17T04:11:49.711 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T04:11:49.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 -- 172.21.15.104:0/833724914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 msgr2=0x7f1734169580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 --2- 172.21.15.104:0/833724914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f1734169580 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f172c005fd0 tx=0x7f172c02a820 comp rx=0 tx=0).stop 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 -- 172.21.15.104:0/833724914 shutdown_connections 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 --2- 172.21.15.104:0/833724914 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f1734169580 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 -- 172.21.15.104:0/833724914 >> 172.21.15.104:0/833724914 conn(0x7f17340d44e0 msgr2=0x7f17340d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 -- 172.21.15.104:0/833724914 shutdown_connections 2024-09-17T04:11:49.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.828+0000 7f1739d8a640 1 -- 172.21.15.104:0/833724914 wait complete. 2024-09-17T04:11:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.830+0000 7f1739d8a640 1 Processor -- start 2024-09-17T04:11:49.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.830+0000 7f1739d8a640 1 -- start start 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173415e7d0 0x7f173414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f173414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173415d740 0x7f17341f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1734169e50 con 0x7f1734162de0 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1734169cd0 con 0x7f173415d740 2024-09-17T04:11:49.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1739d8a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1734169fd0 con 0x7f173415e7d0 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f173414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f173414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44460/0 (socket says 172.21.15.104:44460) 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 -- 172.21.15.104:0/2422241068 learned_addr learned my addr 172.21.15.104:0/2422241068 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f17337fe640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173415e7d0 0x7f173414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1733fff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173415d740 0x7f17341f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 -- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173415e7d0 msgr2=0x7f173414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173415e7d0 0x7f173414c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 -- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173415d740 msgr2=0x7f17341f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173415d740 0x7f17341f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340cd860 con 0x7f1734162de0 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f17337fe640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173415e7d0 0x7f173414c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f1733fff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173415d740 0x7f17341f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:11:49.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.831+0000 7f172bfff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f173414cd80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b3e0 tx=0x7f171c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c015020 con 0x7f1734162de0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f171c011920 con 0x7f1734162de0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c011d70 con 0x7f1734162de0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17340cdb40 con 0x7f1734162de0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173414a790 con 0x7f1734162de0 2024-09-17T04:11:49.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.832+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17341626d0 con 0x7f1734162de0 2024-09-17T04:11:49.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.833+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f171c018020 con 0x7f1734162de0 2024-09-17T04:11:49.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1730ff9640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1714078b90 0x7f171407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f171c09b6b0 con 0x7f1734162de0 2024-09-17T04:11:49.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1730ff9640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f1714082600 0x7f1714084af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17140851c0 con 0x7f1714082600 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f171c09bb40 con 0x7f1734162de0 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f17337fe640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1714078b90 0x7f171407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.834+0000 7f1733fff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f1714082600 0x7f1714084af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.835+0000 7f17337fe640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1714078b90 0x7f171407b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.835+0000 7f1733fff640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f1714082600 0x7f1714084af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.836+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== osd.5 v2:172.21.15.192:6810/4207743842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17140851c0 con 0x7f1714082600 2024-09-17T04:11:49.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.848+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 --> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1734161b30 con 0x7f1714082600 2024-09-17T04:11:49.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1730ff9640 1 -- 172.21.15.104:0/2422241068 <== osd.5 v2:172.21.15.192:6810/4207743842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1734161b30 con 0x7f1714082600 2024-09-17T04:11:49.849 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:49.849 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:49.849 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f1714082600 msgr2=0x7f1714084af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6810/4207743842,v1:172.21.15.192:6811/4207743842] conn(0x7f1714082600 0x7f1714084af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1714078b90 msgr2=0x7f171407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1714078b90 0x7f171407b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724009040 comp rx=0 tx=0).stop 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 msgr2=0x7f173414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 --2- 172.21.15.104:0/2422241068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1734162de0 0x7f173414cd80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b3e0 tx=0x7f171c00b8a0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1733fff640 1 -- 172.21.15.104:0/2422241068 reap_dead start 2024-09-17T04:11:49.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 shutdown_connections 2024-09-17T04:11:49.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 >> 172.21.15.104:0/2422241068 conn(0x7f17340d44e0 msgr2=0x7f173406ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 shutdown_connections 2024-09-17T04:11:49.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.849+0000 7f1739d8a640 1 -- 172.21.15.104:0/2422241068 wait complete. 2024-09-17T04:11:49.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 -- 172.21.15.104:0/1285921138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc0b9ad0 msgr2=0x7f1dfc0d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 --2- 172.21.15.104:0/1285921138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0d0be0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cfba0 tx=0x7f1df002a4b0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 -- 172.21.15.104:0/1285921138 shutdown_connections 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 --2- 172.21.15.104:0/1285921138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 0x7f1dfc0ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 --2- 172.21.15.104:0/1285921138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0d0be0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 --2- 172.21.15.104:0/1285921138 >> v2:172.21.15.192:3300/0 conn(0x7f1dfc15ee80 0x7f1dfc0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 -- 172.21.15.104:0/1285921138 >> 172.21.15.104:0/1285921138 conn(0x7f1dfc09d830 msgr2=0x7f1dfc0b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 -- 172.21.15.104:0/1285921138 shutdown_connections 2024-09-17T04:11:49.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.974+0000 7f1e0149b640 1 -- 172.21.15.104:0/1285921138 wait complete. 2024-09-17T04:11:49.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.976+0000 7f1e0149b640 1 Processor -- start 2024-09-17T04:11:49.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.976+0000 7f1e0149b640 1 -- start start 2024-09-17T04:11:49.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 0x7f1dfc14f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0cf520 con 0x7f1dfc15ee80 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0cf3a0 con 0x7f1dfc0b9ad0 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1e0149b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc0b6580 con 0x7f1dfc0d1120 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44476/0 (socket says 172.21.15.104:44476) 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 -- 172.21.15.104:0/2758836052 learned_addr learned my addr 172.21.15.104:0/2758836052 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfaffd640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfa7fc640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 0x7f1dfc14f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 -- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 msgr2=0x7f1dfc14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 0x7f1dfc14f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 -- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc0b9ad0 msgr2=0x7f1dfc0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 -- 172.21.15.104:0/2758836052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc1f8d70 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.977+0000 7f1dfb7fe640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cab0 tx=0x7f1df400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.978+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4007df0 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.978+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df400f560 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.978+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1f9050 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.978+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400f9b0 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.978+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1f9610 con 0x7f1dfc15ee80 2024-09-17T04:11:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.979+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc0ceb90 con 0x7f1dfc15ee80 2024-09-17T04:11:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.980+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1df400fb50 con 0x7f1dfc15ee80 2024-09-17T04:11:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.980+0000 7f1de37fe640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.980+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f1df409bb10 con 0x7f1dfc15ee80 2024-09-17T04:11:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.980+0000 7f1dfaffd640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.981+0000 7f1dfaffd640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00bb50 tx=0x7f1dec00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:49.985+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1df4014070 con 0x7f1dfc15ee80 2024-09-17T04:11:50.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.161+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f1dfc0d19c0 con 0x7f1de8078b90 2024-09-17T04:11:50.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.162+0000 7f1de37fe640 1 -- 172.21.15.104:0/2758836052 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1dfc0d19c0 con 0x7f1de8078b90 2024-09-17T04:11:50.161 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 msgr2=0x7f1de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 0x7f1de807b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00bb50 tx=0x7f1dec00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 msgr2=0x7f1dfc0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cab0 tx=0x7f1df400cf70 comp rx=0 tx=0).stop 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 shutdown_connections 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f1de8078b90 0x7f1de807b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dfc15ee80 0x7f1dfc0b4fb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dfc0d1120 0x7f1dfc14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 --2- 172.21.15.104:0/2758836052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc0b9ad0 0x7f1dfc0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 >> 172.21.15.104:0/2758836052 conn(0x7f1dfc09d830 msgr2=0x7f1dfc15dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 shutdown_connections 2024-09-17T04:11:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.164+0000 7f1e0149b640 1 -- 172.21.15.104:0/2758836052 wait complete. 2024-09-17T04:11:50.175 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T04:11:50.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 -- 172.21.15.104:0/323393438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 msgr2=0x7feb94162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 --2- 172.21.15.104:0/323393438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb94162600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feb940ba580 tx=0x7feb8c02a8b0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 -- 172.21.15.104:0/323393438 shutdown_connections 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 --2- 172.21.15.104:0/323393438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb94162600 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 --2- 172.21.15.104:0/323393438 >> v2:172.21.15.192:3300/0 conn(0x7feb94161ed0 0x7feb940cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.292+0000 7feb9c464640 1 -- 172.21.15.104:0/323393438 >> 172.21.15.104:0/323393438 conn(0x7feb940d4510 msgr2=0x7feb940d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.293+0000 7feb9c464640 1 -- 172.21.15.104:0/323393438 shutdown_connections 2024-09-17T04:11:50.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.293+0000 7feb9c464640 1 -- 172.21.15.104:0/323393438 wait complete. 2024-09-17T04:11:50.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.294+0000 7feb9c464640 1 Processor -- start 2024-09-17T04:11:50.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.294+0000 7feb9c464640 1 -- start start 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb9414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb940d0460 0x7feb9414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb94161ed0 0x7feb940b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb94162b40 con 0x7feb940cf740 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb940b8270 con 0x7feb94161ed0 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb94162cc0 con 0x7feb940d0460 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb9414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb9414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44496/0 (socket says 172.21.15.104:44496) 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 -- 172.21.15.104:0/295757669 learned_addr learned my addr 172.21.15.104:0/295757669 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9aa01640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb94161ed0 0x7feb940b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb999ff640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb940d0460 0x7feb9414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 -- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb940d0460 msgr2=0x7feb9414c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb940d0460 0x7feb9414c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 -- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb94161ed0 msgr2=0x7feb940b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb94161ed0 0x7feb940b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9414a770 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9a200640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb9414a230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c460 tx=0x7feb9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90016020 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb90012940 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb940b5170 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90012d90 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.296+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb94158c10 con 0x7feb940cf740 2024-09-17T04:11:50.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.297+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb940b5510 con 0x7feb940cf740 2024-09-17T04:11:50.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.298+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb90019020 con 0x7feb940cf740 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb8affd640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb78078bc0 0x7feb7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7feb9009b1b0 con 0x7feb940cf740 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb8affd640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7feb78082630 0x7feb78084b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb90019ec0 con 0x7feb78082630 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb9009b640 con 0x7feb940cf740 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb999ff640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb78078bc0 0x7feb7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.299+0000 7feb9aa01640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7feb78082630 0x7feb78084b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.300+0000 7feb999ff640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb78078bc0 0x7feb7807b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb84005fd0 tx=0x7feb84005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.300+0000 7feb9aa01640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7feb78082630 0x7feb78084b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.301+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== osd.6 v2:172.21.15.192:6818/1564224566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb90019ec0 con 0x7feb78082630 2024-09-17T04:11:50.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.313+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 --> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feb94162600 con 0x7feb78082630 2024-09-17T04:11:50.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb8affd640 1 -- 172.21.15.104:0/295757669 <== osd.6 v2:172.21.15.192:6818/1564224566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feb94162600 con 0x7feb78082630 2024-09-17T04:11:50.314 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:50.314 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:50.314 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7feb78082630 msgr2=0x7feb78084b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6818/1564224566,v1:172.21.15.192:6819/1564224566] conn(0x7feb78082630 0x7feb78084b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb78078bc0 msgr2=0x7feb7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7feb78078bc0 0x7feb7807b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb84005fd0 tx=0x7feb84005850 comp rx=0 tx=0).stop 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 msgr2=0x7feb9414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 --2- 172.21.15.104:0/295757669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb940cf740 0x7feb9414a230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c460 tx=0x7feb9000c920 comp rx=0 tx=0).stop 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9aa01640 1 -- 172.21.15.104:0/295757669 reap_dead start 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 shutdown_connections 2024-09-17T04:11:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 >> 172.21.15.104:0/295757669 conn(0x7feb940d4510 msgr2=0x7feb940d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 shutdown_connections 2024-09-17T04:11:50.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.315+0000 7feb9c464640 1 -- 172.21.15.104:0/295757669 wait complete. 2024-09-17T04:11:50.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 -- 172.21.15.104:0/1780446047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb978004800 msgr2=0x7fb978004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 --2- 172.21.15.104:0/1780446047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb978004800 0x7fb978004c10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb974001050 tx=0x7fb978005830 comp rx=0 tx=0).stop 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb98b59e640 1 -- 172.21.15.104:0/1780446047 reap_dead start 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 -- 172.21.15.104:0/1780446047 shutdown_connections 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 -- 172.21.15.104:0/1780446047 >> 172.21.15.104:0/1780446047 conn(0x7fb98c0b46e0 msgr2=0x7fb98c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 -- 172.21.15.104:0/1780446047 shutdown_connections 2024-09-17T04:11:50.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.438+0000 7fb9911f1640 1 -- 172.21.15.104:0/1780446047 wait complete. 2024-09-17T04:11:50.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.440+0000 7fb9911f1640 1 Processor -- start 2024-09-17T04:11:50.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.440+0000 7fb9911f1640 1 -- start start 2024-09-17T04:11:50.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb978004800 0x7fb98c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb98c151a10 0x7fb98c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c0b62f0 con 0x7fb98c06f7d0 2024-09-17T04:11:50.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c15ce30 con 0x7fb98c151a10 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb9911f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c0b6470 con 0x7fb978004800 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.441+0000 7fb98259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44522/0 (socket says 172.21.15.104:44522) 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 -- 172.21.15.104:0/3088629212 learned_addr learned my addr 172.21.15.104:0/3088629212 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98b59e640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb98c151a10 0x7fb98c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98ad9d640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb978004800 0x7fb98c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 -- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb978004800 msgr2=0x7fb98c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb978004800 0x7fb98c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 -- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb98c151a10 msgr2=0x7fb98c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb98c151a10 0x7fb98c0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 -- 172.21.15.104:0/3088629212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c1f5c60 con 0x7fb98c06f7d0 2024-09-17T04:11:50.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb98259c640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb97402b0d0 tx=0x7fb974006c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974031040 con 0x7fb98c06f7d0 2024-09-17T04:11:50.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9740035f0 con 0x7fb98c06f7d0 2024-09-17T04:11:50.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c1f8480 con 0x7fb98c06f7d0 2024-09-17T04:11:50.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974003a00 con 0x7fb98c06f7d0 2024-09-17T04:11:50.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.442+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c1f8a40 con 0x7fb98c06f7d0 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.443+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c0b71c0 con 0x7fb98c06f7d0 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.444+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb974034070 con 0x7fb98c06f7d0 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.444+0000 7fb983fff640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 0x7fb96c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.445+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb9740bb260 con 0x7fb98c06f7d0 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.445+0000 7fb98ad9d640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 0x7fb96c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.445+0000 7fb98ad9d640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 0x7fb96c07b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb97c003700 tx=0x7fb97c00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.449+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb974082ce0 con 0x7fb98c06f7d0 2024-09-17T04:11:50.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.624+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb98c06fc60 con 0x7fb96c078bc0 2024-09-17T04:11:50.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.625+0000 7fb983fff640 1 -- 172.21.15.104:0/3088629212 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb98c06fc60 con 0x7fb96c078bc0 2024-09-17T04:11:50.624 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T04:11:50.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 msgr2=0x7fb96c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 0x7fb96c07b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb97c003700 tx=0x7fb97c00b260 comp rx=0 tx=0).stop 2024-09-17T04:11:50.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 msgr2=0x7fb98c0c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb97402b0d0 tx=0x7fb974006c10 comp rx=0 tx=0).stop 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 shutdown_connections 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb96c078bc0 0x7fb96c07b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb98c151a10 0x7fb98c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb98c06f7d0 0x7fb98c0c80c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 --2- 172.21.15.104:0/3088629212 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb978004800 0x7fb98c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 >> 172.21.15.104:0/3088629212 conn(0x7fb98c0b46e0 msgr2=0x7fb98c152770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 shutdown_connections 2024-09-17T04:11:50.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.627+0000 7fb9911f1640 1 -- 172.21.15.104:0/3088629212 wait complete. 2024-09-17T04:11:50.638 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T04:11:50.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:11:50.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 -- 172.21.15.104:0/6289238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c06ddf0 msgr2=0x7fd70c06e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 --2- 172.21.15.104:0/6289238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c06ddf0 0x7fd70c06e200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd700005fd0 tx=0x7fd70002a5c0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 -- 172.21.15.104:0/6289238 shutdown_connections 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 --2- 172.21.15.104:0/6289238 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c06ddf0 0x7fd70c06e200 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 --2- 172.21.15.104:0/6289238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c071860 0x7fd70c0cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 -- 172.21.15.104:0/6289238 >> 172.21.15.104:0/6289238 conn(0x7fd70c0d0ac0 msgr2=0x7fd70c073270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 -- 172.21.15.104:0/6289238 shutdown_connections 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.757+0000 7fd712e55640 1 -- 172.21.15.104:0/6289238 wait complete. 2024-09-17T04:11:50.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.759+0000 7fd712e55640 1 Processor -- start 2024-09-17T04:11:50.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.759+0000 7fd712e55640 1 -- start start 2024-09-17T04:11:50.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c06ddf0 0x7fd70c1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd70c071860 0x7fd70c143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 0x7fd70c1e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c06f8a0 con 0x7fd70c15b9e0 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c06f720 con 0x7fd70c071860 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.760+0000 7fd712e55640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd70c06fa20 con 0x7fd70c06ddf0 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 0x7fd70c1e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 0x7fd70c1e80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44534/0 (socket says 172.21.15.104:44534) 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 -- 172.21.15.104:0/4090748797 learned_addr learned my addr 172.21.15.104:0/4090748797 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd70bfff640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd70c071860 0x7fd70c143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd710bf1640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c06ddf0 0x7fd70c1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 -- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c06ddf0 msgr2=0x7fd70c1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c06ddf0 0x7fd70c1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 -- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd70c071860 msgr2=0x7fd70c143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd70c071860 0x7fd70c143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c144330 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd710bf1640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd70c06ddf0 0x7fd70c1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd70bfff640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd70c071860 0x7fd70c143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7113f2640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 0x7fd70c1e80f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c730 tx=0x7fd70400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704003b70 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd704003d10 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c1f5ea0 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70400aab0 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.761+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1f5b00 con 0x7fd70c15b9e0 2024-09-17T04:11:50.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.762+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd70c1f6560 con 0x7fd70c15b9e0 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.763+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd70400ac50 con 0x7fd70c15b9e0 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.763+0000 7fd7097fa640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd6f8078b90 0x7fd6f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fd70409b7b0 con 0x7fd70c15b9e0 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd7097fa640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fd6f80825f0 0x7fd6f8084ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6f80851b0 con 0x7fd6f80825f0 2024-09-17T04:11:50.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd70409bc40 con 0x7fd70c15b9e0 2024-09-17T04:11:50.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd710bf1640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd6f8078b90 0x7fd6f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd70bfff640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fd6f80825f0 0x7fd6f8084ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd70bfff640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fd6f80825f0 0x7fd6f8084ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.764+0000 7fd710bf1640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd6f8078b90 0x7fd6f807b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005fd0 tx=0x7fd6fc00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.765+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== osd.7 v2:172.21.15.192:6802/1452307488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6f80851b0 con 0x7fd6f80825f0 2024-09-17T04:11:50.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.777+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 --> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd70c1440e0 con 0x7fd6f80825f0 2024-09-17T04:11:50.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.778+0000 7fd7097fa640 1 -- 172.21.15.104:0/4090748797 <== osd.7 v2:172.21.15.192:6802/1452307488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd70c1440e0 con 0x7fd6f80825f0 2024-09-17T04:11:50.778 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T04:11:50.778 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:11:50.778 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.778+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fd6f80825f0 msgr2=0x7fd6f8084ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.778+0000 7fd712e55640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6802/1452307488,v1:172.21.15.192:6803/1452307488] conn(0x7fd6f80825f0 0x7fd6f8084ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd6f8078b90 msgr2=0x7fd6f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fd6f8078b90 0x7fd6f807b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005fd0 tx=0x7fd6fc00f360 comp rx=0 tx=0).stop 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 msgr2=0x7fd70c1e80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 --2- 172.21.15.104:0/4090748797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd70c15b9e0 0x7fd70c1e80f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c730 tx=0x7fd70400cbf0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd7113f2640 1 -- 172.21.15.104:0/4090748797 reap_dead start 2024-09-17T04:11:50.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 shutdown_connections 2024-09-17T04:11:50.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 >> 172.21.15.104:0/4090748797 conn(0x7fd70c0d0ac0 msgr2=0x7fd70c15d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 shutdown_connections 2024-09-17T04:11:50.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.779+0000 7fd712e55640 1 -- 172.21.15.104:0/4090748797 wait complete. 2024-09-17T04:11:50.789 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 -- 172.21.15.104:0/3584727733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00d0bb0 msgr2=0x7fc6c0070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 --2- 172.21.15.104:0/3584727733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c0070100 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0071ec0 tx=0x7fc6b802a980 comp rx=0 tx=0).stop 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 -- 172.21.15.104:0/3584727733 shutdown_connections 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 --2- 172.21.15.104:0/3584727733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c0070100 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 --2- 172.21.15.104:0/3584727733 >> v2:172.21.15.192:3300/0 conn(0x7fc6c00cd440 0x7fc6c00d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 --2- 172.21.15.104:0/3584727733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 -- 172.21.15.104:0/3584727733 >> 172.21.15.104:0/3584727733 conn(0x7fc6c00b46e0 msgr2=0x7fc6c00d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 -- 172.21.15.104:0/3584727733 shutdown_connections 2024-09-17T04:11:50.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.903+0000 7fc6c5139640 1 -- 172.21.15.104:0/3584727733 wait complete. 2024-09-17T04:11:50.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.905+0000 7fc6c5139640 1 Processor -- start 2024-09-17T04:11:50.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.905+0000 7fc6c5139640 1 -- start start 2024-09-17T04:11:50.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c014c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c01f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0070a10 con 0x7fc6c00cd440 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0070890 con 0x7fc6c00d0bb0 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6c5139640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c0070b90 con 0x7fc6c00ccc40 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6be59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6be59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44554/0 (socket says 172.21.15.104:44554) 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.906+0000 7fc6be59c640 1 -- 172.21.15.104:0/2278446311 learned_addr learned my addr 172.21.15.104:0/2278446311 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6bf59e640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c01f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6bed9d640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c014c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 -- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 msgr2=0x7fc6c014c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c014c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 -- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c00d0bb0 msgr2=0x7fc6c01f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:50.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c01f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 -- 172.21.15.104:0/2278446311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c00cc840 con 0x7fc6c00cd440 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6bed9d640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c014c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6be59c640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400e790 tx=0x7fc6b400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400eea0 con 0x7fc6c00cd440 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b400cdb0 con 0x7fc6c00cd440 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c00c96e0 con 0x7fc6c00cd440 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4010690 con 0x7fc6c00cd440 2024-09-17T04:11:50.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.907+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c00c9ca0 con 0x7fc6c00cd440 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.908+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c00d0670 con 0x7fc6c00cd440 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.909+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6b4010830 con 0x7fc6c00cd440 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.910+0000 7fc6a77fe640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 0x7fc6ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.910+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fc6b409baf0 con 0x7fc6c00cd440 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.910+0000 7fc6bed9d640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 0x7fc6ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:50.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.911+0000 7fc6bed9d640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 0x7fc6ac07b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009b00 tx=0x7fc6b0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:50.914+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6b40634d0 con 0x7fc6c00cd440 2024-09-17T04:11:51.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.090+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc6c00d2680 con 0x7fc6ac078bc0 2024-09-17T04:11:51.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.091+0000 7fc6a77fe640 1 -- 172.21.15.104:0/2278446311 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc6c00d2680 con 0x7fc6ac078bc0 2024-09-17T04:11:51.090 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 msgr2=0x7fc6ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 0x7fc6ac07b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009b00 tx=0x7fc6b0005f90 comp rx=0 tx=0).stop 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 msgr2=0x7fc6c00cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400e790 tx=0x7fc6b400ec50 comp rx=0 tx=0).stop 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 shutdown_connections 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fc6ac078bc0 0x7fc6ac07b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6c00d0bb0 0x7fc6c01f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6c00cd440 0x7fc6c00cbe10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 --2- 172.21.15.104:0/2278446311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6c00ccc40 0x7fc6c014c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 >> 172.21.15.104:0/2278446311 conn(0x7fc6c00b46e0 msgr2=0x7fc6c00c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:51.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 shutdown_connections 2024-09-17T04:11:51.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.093+0000 7fc6c5139640 1 -- 172.21.15.104:0/2278446311 wait complete. 2024-09-17T04:11:51.104 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 -- 172.21.15.104:0/3503428077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac0b62c0 msgr2=0x7fb2ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 --2- 172.21.15.104:0/3503428077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac0b62c0 0x7fb2ac0744f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0005fd0 tx=0x7fb2a002a540 comp rx=0 tx=0).stop 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 -- 172.21.15.104:0/3503428077 shutdown_connections 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 --2- 172.21.15.104:0/3503428077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac06e500 0x7fb2ac0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 --2- 172.21.15.104:0/3503428077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac0b62c0 0x7fb2ac0744f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 -- 172.21.15.104:0/3503428077 >> 172.21.15.104:0/3503428077 conn(0x7fb2ac073580 msgr2=0x7fb2ac073990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 -- 172.21.15.104:0/3503428077 shutdown_connections 2024-09-17T04:11:51.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.217+0000 7fb2b3807640 1 -- 172.21.15.104:0/3503428077 wait complete. 2024-09-17T04:11:51.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.219+0000 7fb2b3807640 1 Processor -- start 2024-09-17T04:11:51.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.219+0000 7fb2b3807640 1 -- start start 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac0b62c0 0x7fb2ac1f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2ac15b690 0x7fb2ac1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cbcc0 con 0x7fb2ac14cf00 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cbb40 con 0x7fb2ac15b690 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b3807640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cbe40 con 0x7fb2ac0b62c0 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44570/0 (socket says 172.21.15.104:44570) 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 -- 172.21.15.104:0/1282159695 learned_addr learned my addr 172.21.15.104:0/1282159695 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:11:51.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b15a3640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac0b62c0 0x7fb2ac1f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b0da2640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2ac15b690 0x7fb2ac1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 -- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac0b62c0 msgr2=0x7fb2ac1f9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac0b62c0 0x7fb2ac1f9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 -- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2ac15b690 msgr2=0x7fb2ac1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2ac15b690 0x7fb2ac1f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.220+0000 7fb2b1da4640 1 -- 172.21.15.104:0/1282159695 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac1f9fa0 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb2b1da4640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400e6d0 tx=0x7fb2a400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400cab0 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2a400cc50 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac1f6560 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005280 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.221+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac1f9260 con 0x7fb2ac14cf00 2024-09-17T04:11:51.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.222+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac1f62d0 con 0x7fb2ac14cf00 2024-09-17T04:11:51.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.222+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2a4005420 con 0x7fb2ac14cf00 2024-09-17T04:11:51.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.223+0000 7fb29dffb640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 0x7fb29007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:11:51.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.223+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fb2a409b8d0 con 0x7fb2ac14cf00 2024-09-17T04:11:51.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.223+0000 7fb2b15a3640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 0x7fb29007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:11:51.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.224+0000 7fb2b15a3640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 0x7fb29007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0033000 tx=0x7fb2a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:11:51.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.227+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb2a400ce20 con 0x7fb2ac14cf00 2024-09-17T04:11:51.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.398+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2ac0cc2f0 con 0x7fb290078b90 2024-09-17T04:11:51.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.403+0000 7fb29dffb640 1 -- 172.21.15.104:0/1282159695 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333087 (secure 0 0 0) 0x7fb2ac0cc2f0 con 0x7fb290078b90 2024-09-17T04:11:51.407 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:11:51.409 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 msgr2=0x7fb29007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 0x7fb29007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0033000 tx=0x7fb2a0004730 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 msgr2=0x7fb2ac15bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400e6d0 tx=0x7fb2a400eb90 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 shutdown_connections 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fb290078b90 0x7fb29007b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2ac15b690 0x7fb2ac1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2ac14cf00 0x7fb2ac15bda0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 --2- 172.21.15.104:0/1282159695 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2ac0b62c0 0x7fb2ac1f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 >> 172.21.15.104:0/1282159695 conn(0x7fb2ac073580 msgr2=0x7fb2ac0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 shutdown_connections 2024-09-17T04:11:51.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:11:51.407+0000 7fb2b3807640 1 -- 172.21.15.104:0/1282159695 wait complete. 2024-09-17T04:11:51.419 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-17T04:11:51.377968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31505256,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":93,"num_read_kb":434,"num_write":3155,"num_write_kb":34573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8535,"ondisk_log_size":8535,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":348160,"kb_used_data":64000,"kb_used_omap":12,"kb_used_meta":284019,"kb_avail":754626560,"statfs":{"total":773094113280,"available":772737597440,"internally_reserved":0,"allocated":65536000,"data_stored":64014192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":290836016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7750022,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":173,"num_write":80,"num_write_kb":7647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002895"},"pg_stats":[{"pgid":"2.1f","version":"29'26","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507130+0000","last_change":"2024-09-17T04:09:39.339518+0000","last_active":"2024-09-17T04:11:36.507130+0000","last_peered":"2024-09-17T04:11:36.507130+0000","last_clean":"2024-09-17T04:11:36.507130+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:36.507130+0000","last_undegraded":"2024-09-17T04:11:36.507130+0000","last_fullsized":"2024-09-17T04:11:36.507130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:07.106288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'46","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716562+0000","last_change":"2024-09-17T04:09:40.356150+0000","last_active":"2024-09-17T04:11:42.716562+0000","last_peered":"2024-09-17T04:11:42.716562+0000","last_clean":"2024-09-17T04:11:42.716562+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:42.716562+0000","last_undegraded":"2024-09-17T04:11:42.716562+0000","last_fullsized":"2024-09-17T04:11:42.716562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:07.305276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.735676+0000","last_change":"2024-09-17T04:09:44.495488+0000","last_active":"2024-09-17T04:11:40.735676+0000","last_peered":"2024-09-17T04:11:40.735676+0000","last_clean":"2024-09-17T04:11:40.735676+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:11:40.735676+0000","last_undegraded":"2024-09-17T04:11:40.735676+0000","last_fullsized":"2024-09-17T04:11:40.735676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:36.023189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'32","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.062024+0000","last_change":"2024-09-17T04:09:39.338550+0000","last_active":"2024-09-17T04:11:39.062024+0000","last_peered":"2024-09-17T04:11:39.062024+0000","last_clean":"2024-09-17T04:11:39.062024+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:39.062024+0000","last_undegraded":"2024-09-17T04:11:39.062024+0000","last_fullsized":"2024-09-17T04:11:39.062024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:44.370918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'57","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712077+0000","last_change":"2024-09-17T04:09:40.342269+0000","last_active":"2024-09-17T04:11:42.712077+0000","last_peered":"2024-09-17T04:11:42.712077+0000","last_clean":"2024-09-17T04:11:42.712077+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:42.712077+0000","last_undegraded":"2024-09-17T04:11:42.712077+0000","last_fullsized":"2024-09-17T04:11:42.712077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.580956+0000","last_change":"2024-09-17T04:09:44.388881+0000","last_active":"2024-09-17T04:11:41.580956+0000","last_peered":"2024-09-17T04:11:41.580956+0000","last_clean":"2024-09-17T04:11:41.580956+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:11:41.580956+0000","last_undegraded":"2024-09-17T04:11:41.580956+0000","last_fullsized":"2024-09-17T04:11:41.580956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.955673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'59","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.710543+0000","last_change":"2024-09-17T04:09:39.345211+0000","last_active":"2024-09-17T04:11:43.710543+0000","last_peered":"2024-09-17T04:11:43.710543+0000","last_clean":"2024-09-17T04:11:43.710543+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:43.710543+0000","last_undegraded":"2024-09-17T04:11:43.710543+0000","last_fullsized":"2024-09-17T04:11:43.710543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5379101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":5270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712715+0000","last_change":"2024-09-17T04:09:40.344624+0000","last_active":"2024-09-17T04:11:42.712715+0000","last_peered":"2024-09-17T04:11:42.712715+0000","last_clean":"2024-09-17T04:11:42.712715+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:42.712715+0000","last_undegraded":"2024-09-17T04:11:42.712715+0000","last_fullsized":"2024-09-17T04:11:42.712715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'44","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579980+0000","last_change":"2024-09-17T04:09:44.386101+0000","last_active":"2024-09-17T04:11:41.579980+0000","last_peered":"2024-09-17T04:11:41.579980+0000","last_clean":"2024-09-17T04:11:41.579980+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:11:41.579980+0000","last_undegraded":"2024-09-17T04:11:41.579980+0000","last_fullsized":"2024-09-17T04:11:41.579980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.419614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'16","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.502238+0000","last_change":"2024-09-17T04:09:39.341046+0000","last_active":"2024-09-17T04:11:36.502238+0000","last_peered":"2024-09-17T04:11:36.502238+0000","last_clean":"2024-09-17T04:11:36.502238+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:36.502238+0000","last_undegraded":"2024-09-17T04:11:36.502238+0000","last_fullsized":"2024-09-17T04:11:36.502238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712664+0000","last_change":"2024-09-17T04:09:40.348303+0000","last_active":"2024-09-17T04:11:42.712664+0000","last_peered":"2024-09-17T04:11:42.712664+0000","last_clean":"2024-09-17T04:11:42.712664+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:42.712664+0000","last_undegraded":"2024-09-17T04:11:42.712664+0000","last_fullsized":"2024-09-17T04:11:42.712664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.750069+0000","last_change":"2024-09-17T04:09:44.383241+0000","last_active":"2024-09-17T04:11:40.750069+0000","last_peered":"2024-09-17T04:11:40.750069+0000","last_clean":"2024-09-17T04:11:40.750069+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:11:40.750069+0000","last_undegraded":"2024-09-17T04:11:40.750069+0000","last_fullsized":"2024-09-17T04:11:40.750069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:13.465406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.711710+0000","last_change":"2024-09-17T04:09:40.355868+0000","last_active":"2024-09-17T04:11:42.711710+0000","last_peered":"2024-09-17T04:11:42.711710+0000","last_clean":"2024-09-17T04:11:42.711710+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:42.711710+0000","last_undegraded":"2024-09-17T04:11:42.711710+0000","last_fullsized":"2024-09-17T04:11:42.711710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'230","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.496576+0000","last_change":"2024-09-17T04:09:39.344630+0000","last_active":"2024-09-17T04:11:36.496576+0000","last_peered":"2024-09-17T04:11:36.496576+0000","last_clean":"2024-09-17T04:11:36.496576+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:36.496576+0000","last_undegraded":"2024-09-17T04:11:36.496576+0000","last_fullsized":"2024-09-17T04:11:36.496576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:41.624194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'41","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.748495+0000","last_change":"2024-09-17T04:09:44.389521+0000","last_active":"2024-09-17T04:11:40.748495+0000","last_peered":"2024-09-17T04:11:40.748495+0000","last_clean":"2024-09-17T04:11:40.748495+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:40.748495+0000","last_undegraded":"2024-09-17T04:11:40.748495+0000","last_fullsized":"2024-09-17T04:11:40.748495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.843791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720958+0000","last_change":"2024-09-17T04:09:40.357475+0000","last_active":"2024-09-17T04:11:42.720958+0000","last_peered":"2024-09-17T04:11:42.720958+0000","last_clean":"2024-09-17T04:11:42.720958+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:42.720958+0000","last_undegraded":"2024-09-17T04:11:42.720958+0000","last_fullsized":"2024-09-17T04:11:42.720958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.710687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500739+0000","last_change":"2024-09-17T04:09:39.337419+0000","last_active":"2024-09-17T04:11:36.500739+0000","last_peered":"2024-09-17T04:11:36.500739+0000","last_clean":"2024-09-17T04:11:36.500739+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:36.500739+0000","last_undegraded":"2024-09-17T04:11:36.500739+0000","last_fullsized":"2024-09-17T04:11:36.500739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:53.010057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'48","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577284+0000","last_change":"2024-09-17T04:09:44.389886+0000","last_active":"2024-09-17T04:11:41.577284+0000","last_peered":"2024-09-17T04:11:41.577284+0000","last_clean":"2024-09-17T04:11:41.577284+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:41.577284+0000","last_undegraded":"2024-09-17T04:11:41.577284+0000","last_fullsized":"2024-09-17T04:11:41.577284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:14.273128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714637+0000","last_change":"2024-09-17T04:09:40.352895+0000","last_active":"2024-09-17T04:11:42.714637+0000","last_peered":"2024-09-17T04:11:42.714637+0000","last_clean":"2024-09-17T04:11:42.714637+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:42.714637+0000","last_undegraded":"2024-09-17T04:11:42.714637+0000","last_fullsized":"2024-09-17T04:11:42.714637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:35.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'28","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.576539+0000","last_change":"2024-09-17T04:09:39.338924+0000","last_active":"2024-09-17T04:11:41.576539+0000","last_peered":"2024-09-17T04:11:41.576539+0000","last_clean":"2024-09-17T04:11:41.576539+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:41.576539+0000","last_undegraded":"2024-09-17T04:11:41.576539+0000","last_fullsized":"2024-09-17T04:11:41.576539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:05.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.744853+0000","last_change":"2024-09-17T04:09:44.491513+0000","last_active":"2024-09-17T04:11:40.744853+0000","last_peered":"2024-09-17T04:11:40.744853+0000","last_clean":"2024-09-17T04:11:40.744853+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:11:40.744853+0000","last_undegraded":"2024-09-17T04:11:40.744853+0000","last_fullsized":"2024-09-17T04:11:40.744853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:42.510908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487545+0000","last_change":"2024-09-17T04:09:40.347799+0000","last_active":"2024-09-17T04:11:43.487545+0000","last_peered":"2024-09-17T04:11:43.487545+0000","last_clean":"2024-09-17T04:11:43.487545+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:43.487545+0000","last_undegraded":"2024-09-17T04:11:43.487545+0000","last_fullsized":"2024-09-17T04:11:43.487545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.514996+0000","last_change":"2024-09-17T04:09:39.339476+0000","last_active":"2024-09-17T04:11:36.514996+0000","last_peered":"2024-09-17T04:11:36.514996+0000","last_clean":"2024-09-17T04:11:36.514996+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:36.514996+0000","last_undegraded":"2024-09-17T04:11:36.514996+0000","last_fullsized":"2024-09-17T04:11:36.514996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.738221+0000","last_change":"2024-09-17T04:09:44.389232+0000","last_active":"2024-09-17T04:11:40.738221+0000","last_peered":"2024-09-17T04:11:40.738221+0000","last_clean":"2024-09-17T04:11:40.738221+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:40.738221+0000","last_undegraded":"2024-09-17T04:11:40.738221+0000","last_fullsized":"2024-09-17T04:11:40.738221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:24.915057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.488400+0000","last_change":"2024-09-17T04:09:40.346095+0000","last_active":"2024-09-17T04:11:43.488400+0000","last_peered":"2024-09-17T04:11:43.488400+0000","last_clean":"2024-09-17T04:11:43.488400+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:43.488400+0000","last_undegraded":"2024-09-17T04:11:43.488400+0000","last_fullsized":"2024-09-17T04:11:43.488400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.349939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'26","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.484708+0000","last_change":"2024-09-17T04:09:39.341423+0000","last_active":"2024-09-17T04:11:43.484708+0000","last_peered":"2024-09-17T04:11:43.484708+0000","last_clean":"2024-09-17T04:11:43.484708+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:43.484708+0000","last_undegraded":"2024-09-17T04:11:43.484708+0000","last_fullsized":"2024-09-17T04:11:43.484708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'46","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.745357+0000","last_change":"2024-09-17T04:09:44.492540+0000","last_active":"2024-09-17T04:11:40.745357+0000","last_peered":"2024-09-17T04:11:40.745357+0000","last_clean":"2024-09-17T04:11:40.745357+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:40.745357+0000","last_undegraded":"2024-09-17T04:11:40.745357+0000","last_fullsized":"2024-09-17T04:11:40.745357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:42.616992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715413+0000","last_change":"2024-09-17T04:09:40.360255+0000","last_active":"2024-09-17T04:11:42.715413+0000","last_peered":"2024-09-17T04:11:42.715413+0000","last_clean":"2024-09-17T04:11:42.715413+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:42.715413+0000","last_undegraded":"2024-09-17T04:11:42.715413+0000","last_fullsized":"2024-09-17T04:11:42.715413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:34.637812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'51","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.361222+0000","last_change":"2024-09-17T04:09:39.343895+0000","last_active":"2024-09-17T04:11:42.361222+0000","last_peered":"2024-09-17T04:11:42.361222+0000","last_clean":"2024-09-17T04:11:42.361222+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:42.361222+0000","last_undegraded":"2024-09-17T04:11:42.361222+0000","last_fullsized":"2024-09-17T04:11:42.361222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:09.103996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'51","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.579480+0000","last_change":"2024-09-17T04:09:44.493734+0000","last_active":"2024-09-17T04:11:41.579480+0000","last_peered":"2024-09-17T04:11:41.579480+0000","last_clean":"2024-09-17T04:11:41.579480+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:11:41.579480+0000","last_undegraded":"2024-09-17T04:11:41.579480+0000","last_fullsized":"2024-09-17T04:11:41.579480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.764660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'45","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.489456+0000","last_change":"2024-09-17T04:09:40.343318+0000","last_active":"2024-09-17T04:11:43.489456+0000","last_peered":"2024-09-17T04:11:43.489456+0000","last_clean":"2024-09-17T04:11:43.489456+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:43.489456+0000","last_undegraded":"2024-09-17T04:11:43.489456+0000","last_fullsized":"2024-09-17T04:11:43.489456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:01.334086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.508913+0000","last_change":"2024-09-17T04:09:39.338672+0000","last_active":"2024-09-17T04:11:36.508913+0000","last_peered":"2024-09-17T04:11:36.508913+0000","last_clean":"2024-09-17T04:11:36.508913+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:36.508913+0000","last_undegraded":"2024-09-17T04:11:36.508913+0000","last_fullsized":"2024-09-17T04:11:36.508913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.861894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'43","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.583233+0000","last_change":"2024-09-17T04:09:44.492647+0000","last_active":"2024-09-17T04:11:41.583233+0000","last_peered":"2024-09-17T04:11:41.583233+0000","last_clean":"2024-09-17T04:11:41.583233+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:11:41.583233+0000","last_undegraded":"2024-09-17T04:11:41.583233+0000","last_fullsized":"2024-09-17T04:11:41.583233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'46","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487146+0000","last_change":"2024-09-17T04:10:20.524590+0000","last_active":"2024-09-17T04:11:43.487146+0000","last_peered":"2024-09-17T04:11:43.487146+0000","last_clean":"2024-09-17T04:11:43.487146+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:43.487146+0000","last_undegraded":"2024-09-17T04:11:43.487146+0000","last_fullsized":"2024-09-17T04:11:43.487146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.508970+0000","last_change":"2024-09-17T04:09:39.335489+0000","last_active":"2024-09-17T04:11:36.508970+0000","last_peered":"2024-09-17T04:11:36.508970+0000","last_clean":"2024-09-17T04:11:36.508970+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:36.508970+0000","last_undegraded":"2024-09-17T04:11:36.508970+0000","last_fullsized":"2024-09-17T04:11:36.508970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:03.317374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734857+0000","last_change":"2024-09-17T04:09:44.393882+0000","last_active":"2024-09-17T04:11:40.734857+0000","last_peered":"2024-09-17T04:11:40.734857+0000","last_clean":"2024-09-17T04:11:40.734857+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:40.734857+0000","last_undegraded":"2024-09-17T04:11:40.734857+0000","last_fullsized":"2024-09-17T04:11:40.734857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:53.876654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'55","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.703267+0000","last_change":"2024-09-17T04:09:40.341216+0000","last_active":"2024-09-17T04:11:42.703267+0000","last_peered":"2024-09-17T04:11:42.703267+0000","last_clean":"2024-09-17T04:11:42.703267+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:42.703267+0000","last_undegraded":"2024-09-17T04:11:42.703267+0000","last_fullsized":"2024-09-17T04:11:42.703267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'24","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.505881+0000","last_change":"2024-09-17T04:09:39.340452+0000","last_active":"2024-09-17T04:11:42.505881+0000","last_peered":"2024-09-17T04:11:42.505881+0000","last_clean":"2024-09-17T04:11:42.505881+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:42.505881+0000","last_undegraded":"2024-09-17T04:11:42.505881+0000","last_fullsized":"2024-09-17T04:11:42.505881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.752662+0000","last_change":"2024-09-17T04:09:44.392023+0000","last_active":"2024-09-17T04:11:40.752662+0000","last_peered":"2024-09-17T04:11:40.752662+0000","last_clean":"2024-09-17T04:11:40.752662+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:11:40.752662+0000","last_undegraded":"2024-09-17T04:11:40.752662+0000","last_fullsized":"2024-09-17T04:11:40.752662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:33.697993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'45","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.697155+0000","last_change":"2024-09-17T04:09:40.338072+0000","last_active":"2024-09-17T04:11:42.697155+0000","last_peered":"2024-09-17T04:11:42.697155+0000","last_clean":"2024-09-17T04:11:42.697155+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:42.697155+0000","last_undegraded":"2024-09-17T04:11:42.697155+0000","last_fullsized":"2024-09-17T04:11:42.697155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:37.649898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'56","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.480749+0000","last_change":"2024-09-17T04:09:39.337169+0000","last_active":"2024-09-17T04:11:43.480749+0000","last_peered":"2024-09-17T04:11:43.480749+0000","last_clean":"2024-09-17T04:11:43.480749+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:43.480749+0000","last_undegraded":"2024-09-17T04:11:43.480749+0000","last_fullsized":"2024-09-17T04:11:43.480749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":27,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.720137+0000","last_change":"2024-09-17T04:09:44.392500+0000","last_active":"2024-09-17T04:11:40.720137+0000","last_peered":"2024-09-17T04:11:40.720137+0000","last_clean":"2024-09-17T04:11:40.720137+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:11:40.720137+0000","last_undegraded":"2024-09-17T04:11:40.720137+0000","last_fullsized":"2024-09-17T04:11:40.720137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:03.260455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'43","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716834+0000","last_change":"2024-09-17T04:09:40.339223+0000","last_active":"2024-09-17T04:11:42.716834+0000","last_peered":"2024-09-17T04:11:42.716834+0000","last_clean":"2024-09-17T04:11:42.716834+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:42.716834+0000","last_undegraded":"2024-09-17T04:11:42.716834+0000","last_fullsized":"2024-09-17T04:11:42.716834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'21","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.512580+0000","last_change":"2024-09-17T04:09:39.339953+0000","last_active":"2024-09-17T04:11:38.512580+0000","last_peered":"2024-09-17T04:11:38.512580+0000","last_clean":"2024-09-17T04:11:38.512580+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:38.512580+0000","last_undegraded":"2024-09-17T04:11:38.512580+0000","last_fullsized":"2024-09-17T04:11:38.512580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:45.372447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734313+0000","last_change":"2024-09-17T04:09:44.490641+0000","last_active":"2024-09-17T04:11:40.734313+0000","last_peered":"2024-09-17T04:11:40.734313+0000","last_clean":"2024-09-17T04:11:40.734313+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:40.734313+0000","last_undegraded":"2024-09-17T04:11:40.734313+0000","last_fullsized":"2024-09-17T04:11:40.734313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:53.093836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'57","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.709660+0000","last_change":"2024-09-17T04:10:20.524400+0000","last_active":"2024-09-17T04:11:42.709660+0000","last_peered":"2024-09-17T04:11:42.709660+0000","last_clean":"2024-09-17T04:11:42.709660+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:42.709660+0000","last_undegraded":"2024-09-17T04:11:42.709660+0000","last_fullsized":"2024-09-17T04:11:42.709660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'20","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.553052+0000","last_change":"2024-09-17T04:09:39.338325+0000","last_active":"2024-09-17T04:11:40.553052+0000","last_peered":"2024-09-17T04:11:40.553052+0000","last_clean":"2024-09-17T04:11:40.553052+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:40.553052+0000","last_undegraded":"2024-09-17T04:11:40.553052+0000","last_fullsized":"2024-09-17T04:11:40.553052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:10:20.773163+0000","last_change":"2024-09-17T04:09:31.132621+0000","last_active":"2024-09-17T04:10:20.773163+0000","last_peered":"2024-09-17T04:10:20.773163+0000","last_clean":"2024-09-17T04:10:20.773163+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:10:20.773163+0000","last_undegraded":"2024-09-17T04:10:20.773163+0000","last_fullsized":"2024-09-17T04:10:20.773163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:29.920232+0000","last_clean_scrub_stamp":"2024-09-17T04:09:29.920232+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.552813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'35","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.752842+0000","last_change":"2024-09-17T04:09:44.494775+0000","last_active":"2024-09-17T04:11:40.752842+0000","last_peered":"2024-09-17T04:11:40.752842+0000","last_clean":"2024-09-17T04:11:40.752842+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:11:40.752842+0000","last_undegraded":"2024-09-17T04:11:40.752842+0000","last_fullsized":"2024-09-17T04:11:40.752842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:22.449566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726744+0000","last_change":"2024-09-17T04:09:40.365424+0000","last_active":"2024-09-17T04:11:42.726744+0000","last_peered":"2024-09-17T04:11:42.726744+0000","last_clean":"2024-09-17T04:11:42.726744+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:42.726744+0000","last_undegraded":"2024-09-17T04:11:42.726744+0000","last_fullsized":"2024-09-17T04:11:42.726744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.507264+0000","last_change":"2024-09-17T04:09:39.340189+0000","last_active":"2024-09-17T04:11:36.507264+0000","last_peered":"2024-09-17T04:11:36.507264+0000","last_clean":"2024-09-17T04:11:36.507264+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:36.507264+0000","last_undegraded":"2024-09-17T04:11:36.507264+0000","last_fullsized":"2024-09-17T04:11:36.507264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'34","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747834+0000","last_change":"2024-09-17T04:10:20.777190+0000","last_active":"2024-09-17T04:11:40.747834+0000","last_peered":"2024-09-17T04:11:40.747834+0000","last_clean":"2024-09-17T04:11:40.747834+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:11:40.747834+0000","last_undegraded":"2024-09-17T04:11:40.747834+0000","last_fullsized":"2024-09-17T04:11:40.747834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704033+0000","last_change":"2024-09-17T04:09:40.356149+0000","last_active":"2024-09-17T04:11:42.704033+0000","last_peered":"2024-09-17T04:11:42.704033+0000","last_clean":"2024-09-17T04:11:42.704033+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:42.704033+0000","last_undegraded":"2024-09-17T04:11:42.704033+0000","last_fullsized":"2024-09-17T04:11:42.704033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.495819+0000","last_change":"2024-09-17T04:09:39.330509+0000","last_active":"2024-09-17T04:11:36.495819+0000","last_peered":"2024-09-17T04:11:36.495819+0000","last_clean":"2024-09-17T04:11:36.495819+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:36.495819+0000","last_undegraded":"2024-09-17T04:11:36.495819+0000","last_fullsized":"2024-09-17T04:11:36.495819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:20.425723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.577119+0000","last_change":"2024-09-17T04:09:44.389247+0000","last_active":"2024-09-17T04:11:41.577119+0000","last_peered":"2024-09-17T04:11:41.577119+0000","last_clean":"2024-09-17T04:11:41.577119+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:11:41.577119+0000","last_undegraded":"2024-09-17T04:11:41.577119+0000","last_fullsized":"2024-09-17T04:11:41.577119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:56.332255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728585+0000","last_change":"2024-09-17T04:09:40.363612+0000","last_active":"2024-09-17T04:11:42.728585+0000","last_peered":"2024-09-17T04:11:42.728585+0000","last_clean":"2024-09-17T04:11:42.728585+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:42.728585+0000","last_undegraded":"2024-09-17T04:11:42.728585+0000","last_fullsized":"2024-09-17T04:11:42.728585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:49.053576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.509070+0000","last_change":"2024-09-17T04:09:39.339552+0000","last_active":"2024-09-17T04:11:36.509070+0000","last_peered":"2024-09-17T04:11:36.509070+0000","last_clean":"2024-09-17T04:11:36.509070+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:36.509070+0000","last_undegraded":"2024-09-17T04:11:36.509070+0000","last_fullsized":"2024-09-17T04:11:36.509070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:50.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'50","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.576524+0000","last_change":"2024-09-17T04:09:44.491211+0000","last_active":"2024-09-17T04:11:41.576524+0000","last_peered":"2024-09-17T04:11:41.576524+0000","last_clean":"2024-09-17T04:11:41.576524+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:11:41.576524+0000","last_undegraded":"2024-09-17T04:11:41.576524+0000","last_fullsized":"2024-09-17T04:11:41.576524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:48.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726118+0000","last_change":"2024-09-17T04:09:40.364393+0000","last_active":"2024-09-17T04:11:42.726118+0000","last_peered":"2024-09-17T04:11:42.726118+0000","last_clean":"2024-09-17T04:11:42.726118+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:11:42.726118+0000","last_undegraded":"2024-09-17T04:11:42.726118+0000","last_fullsized":"2024-09-17T04:11:42.726118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.275449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.498143+0000","last_change":"2024-09-17T04:09:39.335413+0000","last_active":"2024-09-17T04:11:36.498143+0000","last_peered":"2024-09-17T04:11:36.498143+0000","last_clean":"2024-09-17T04:11:36.498143+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:36.498143+0000","last_undegraded":"2024-09-17T04:11:36.498143+0000","last_fullsized":"2024-09-17T04:11:36.498143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:54.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'47","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.734413+0000","last_change":"2024-09-17T04:09:44.388223+0000","last_active":"2024-09-17T04:11:40.734413+0000","last_peered":"2024-09-17T04:11:40.734413+0000","last_clean":"2024-09-17T04:11:40.734413+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:40.734413+0000","last_undegraded":"2024-09-17T04:11:40.734413+0000","last_fullsized":"2024-09-17T04:11:40.734413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.913200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'47","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.724540+0000","last_change":"2024-09-17T04:09:40.363158+0000","last_active":"2024-09-17T04:11:42.724540+0000","last_peered":"2024-09-17T04:11:42.724540+0000","last_clean":"2024-09-17T04:11:42.724540+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:11:42.724540+0000","last_undegraded":"2024-09-17T04:11:42.724540+0000","last_fullsized":"2024-09-17T04:11:42.724540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'33","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486531+0000","last_change":"2024-09-17T04:09:39.333285+0000","last_active":"2024-09-17T04:11:43.486531+0000","last_peered":"2024-09-17T04:11:43.486531+0000","last_clean":"2024-09-17T04:11:43.486531+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:43.486531+0000","last_undegraded":"2024-09-17T04:11:43.486531+0000","last_fullsized":"2024-09-17T04:11:43.486531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:33.716268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'54","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.708373+0000","last_change":"2024-09-17T04:09:44.395504+0000","last_active":"2024-09-17T04:11:40.708373+0000","last_peered":"2024-09-17T04:11:40.708373+0000","last_clean":"2024-09-17T04:11:40.708373+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:11:40.708373+0000","last_undegraded":"2024-09-17T04:11:40.708373+0000","last_fullsized":"2024-09-17T04:11:40.708373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:23.716337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.702217+0000","last_change":"2024-09-17T04:09:40.360107+0000","last_active":"2024-09-17T04:11:42.702217+0000","last_peered":"2024-09-17T04:11:42.702217+0000","last_clean":"2024-09-17T04:11:42.702217+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:42.702217+0000","last_undegraded":"2024-09-17T04:11:42.702217+0000","last_fullsized":"2024-09-17T04:11:42.702217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'30","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:39.862284+0000","last_change":"2024-09-17T04:09:39.341426+0000","last_active":"2024-09-17T04:11:39.862284+0000","last_peered":"2024-09-17T04:11:39.862284+0000","last_clean":"2024-09-17T04:11:39.862284+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:39.862284+0000","last_undegraded":"2024-09-17T04:11:39.862284+0000","last_fullsized":"2024-09-17T04:11:39.862284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:53.671514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'43","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.739540+0000","last_change":"2024-09-17T04:10:20.775487+0000","last_active":"2024-09-17T04:11:40.739540+0000","last_peered":"2024-09-17T04:11:40.739540+0000","last_clean":"2024-09-17T04:11:40.739540+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:11:40.739540+0000","last_undegraded":"2024-09-17T04:11:40.739540+0000","last_fullsized":"2024-09-17T04:11:40.739540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:23.072496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729353+0000","last_change":"2024-09-17T04:09:40.363921+0000","last_active":"2024-09-17T04:11:42.729353+0000","last_peered":"2024-09-17T04:11:42.729353+0000","last_clean":"2024-09-17T04:11:42.729353+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:11:42.729353+0000","last_undegraded":"2024-09-17T04:11:42.729353+0000","last_fullsized":"2024-09-17T04:11:42.729353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:50.948890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'35","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.672344+0000","last_change":"2024-09-17T04:09:39.339779+0000","last_active":"2024-09-17T04:11:38.672344+0000","last_peered":"2024-09-17T04:11:38.672344+0000","last_clean":"2024-09-17T04:11:38.672344+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:38.672344+0000","last_undegraded":"2024-09-17T04:11:38.672344+0000","last_fullsized":"2024-09-17T04:11:38.672344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:28.228292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'34","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.714640+0000","last_change":"2024-09-17T04:09:44.490999+0000","last_active":"2024-09-17T04:11:40.714640+0000","last_peered":"2024-09-17T04:11:40.714640+0000","last_clean":"2024-09-17T04:11:40.714640+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:11:40.714640+0000","last_undegraded":"2024-09-17T04:11:40.714640+0000","last_fullsized":"2024-09-17T04:11:40.714640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:51.185605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487153+0000","last_change":"2024-09-17T04:09:40.355534+0000","last_active":"2024-09-17T04:11:43.487153+0000","last_peered":"2024-09-17T04:11:43.487153+0000","last_clean":"2024-09-17T04:11:43.487153+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:43.487153+0000","last_undegraded":"2024-09-17T04:11:43.487153+0000","last_fullsized":"2024-09-17T04:11:43.487153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:54.368927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'17","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.511219+0000","last_change":"2024-09-17T04:09:39.338095+0000","last_active":"2024-09-17T04:11:36.511219+0000","last_peered":"2024-09-17T04:11:36.511219+0000","last_clean":"2024-09-17T04:11:36.511219+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:36.511219+0000","last_undegraded":"2024-09-17T04:11:36.511219+0000","last_fullsized":"2024-09-17T04:11:36.511219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.360866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'38","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.578153+0000","last_change":"2024-09-17T04:09:44.491458+0000","last_active":"2024-09-17T04:11:41.578153+0000","last_peered":"2024-09-17T04:11:41.578153+0000","last_clean":"2024-09-17T04:11:41.578153+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:11:41.578153+0000","last_undegraded":"2024-09-17T04:11:41.578153+0000","last_fullsized":"2024-09-17T04:11:41.578153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:10.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726285+0000","last_change":"2024-09-17T04:09:40.361961+0000","last_active":"2024-09-17T04:11:42.726285+0000","last_peered":"2024-09-17T04:11:42.726285+0000","last_clean":"2024-09-17T04:11:42.726285+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:11:42.726285+0000","last_undegraded":"2024-09-17T04:11:42.726285+0000","last_fullsized":"2024-09-17T04:11:42.726285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1191","reported_seq":1218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:38.685750+0000","last_change":"2024-09-17T04:09:39.341850+0000","last_active":"2024-09-17T04:11:38.685750+0000","last_peered":"2024-09-17T04:11:38.685750+0000","last_clean":"2024-09-17T04:11:38.685750+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:38.685750+0000","last_undegraded":"2024-09-17T04:11:38.685750+0000","last_fullsized":"2024-09-17T04:11:38.685750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":5144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.715571+0000","last_change":"2024-09-17T04:09:44.393781+0000","last_active":"2024-09-17T04:11:40.715571+0000","last_peered":"2024-09-17T04:11:40.715571+0000","last_clean":"2024-09-17T04:11:40.715571+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:11:40.715571+0000","last_undegraded":"2024-09-17T04:11:40.715571+0000","last_fullsized":"2024-09-17T04:11:40.715571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:25.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715263+0000","last_change":"2024-09-17T04:09:40.359803+0000","last_active":"2024-09-17T04:11:42.715263+0000","last_peered":"2024-09-17T04:11:42.715263+0000","last_clean":"2024-09-17T04:11:42.715263+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:42.715263+0000","last_undegraded":"2024-09-17T04:11:42.715263+0000","last_fullsized":"2024-09-17T04:11:42.715263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:53.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'41","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.488250+0000","last_change":"2024-09-17T04:09:39.341188+0000","last_active":"2024-09-17T04:11:43.488250+0000","last_peered":"2024-09-17T04:11:43.488250+0000","last_clean":"2024-09-17T04:11:43.488250+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:43.488250+0000","last_undegraded":"2024-09-17T04:11:43.488250+0000","last_fullsized":"2024-09-17T04:11:43.488250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:20.808709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'45","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.728486+0000","last_change":"2024-09-17T04:09:44.386544+0000","last_active":"2024-09-17T04:11:40.728486+0000","last_peered":"2024-09-17T04:11:40.728486+0000","last_clean":"2024-09-17T04:11:40.728486+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:11:40.728486+0000","last_undegraded":"2024-09-17T04:11:40.728486+0000","last_fullsized":"2024-09-17T04:11:40.728486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:55.711151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714395+0000","last_change":"2024-09-17T04:10:20.772111+0000","last_active":"2024-09-17T04:11:42.714395+0000","last_peered":"2024-09-17T04:11:42.714395+0000","last_clean":"2024-09-17T04:11:42.714395+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:42.714395+0000","last_undegraded":"2024-09-17T04:11:42.714395+0000","last_fullsized":"2024-09-17T04:11:42.714395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.090846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'24","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.503007+0000","last_change":"2024-09-17T04:09:39.344120+0000","last_active":"2024-09-17T04:11:36.503007+0000","last_peered":"2024-09-17T04:11:36.503007+0000","last_clean":"2024-09-17T04:11:36.503007+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:36.503007+0000","last_undegraded":"2024-09-17T04:11:36.503007+0000","last_fullsized":"2024-09-17T04:11:36.503007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:48.741850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'39","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.724578+0000","last_change":"2024-09-17T04:09:44.387073+0000","last_active":"2024-09-17T04:11:40.724578+0000","last_peered":"2024-09-17T04:11:40.724578+0000","last_clean":"2024-09-17T04:11:40.724578+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:11:40.724578+0000","last_undegraded":"2024-09-17T04:11:40.724578+0000","last_fullsized":"2024-09-17T04:11:40.724578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:02.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'73","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486351+0000","last_change":"2024-09-17T04:09:40.355661+0000","last_active":"2024-09-17T04:11:43.486351+0000","last_peered":"2024-09-17T04:11:43.486351+0000","last_clean":"2024-09-17T04:11:43.486351+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:43.486351+0000","last_undegraded":"2024-09-17T04:11:43.486351+0000","last_fullsized":"2024-09-17T04:11:43.486351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:03.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'23","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.501810+0000","last_change":"2024-09-17T04:09:39.343209+0000","last_active":"2024-09-17T04:11:36.501810+0000","last_peered":"2024-09-17T04:11:36.501810+0000","last_clean":"2024-09-17T04:11:36.501810+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:36.501810+0000","last_undegraded":"2024-09-17T04:11:36.501810+0000","last_fullsized":"2024-09-17T04:11:36.501810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:24.564272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'42","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747723+0000","last_change":"2024-09-17T04:09:44.495392+0000","last_active":"2024-09-17T04:11:40.747723+0000","last_peered":"2024-09-17T04:11:40.747723+0000","last_clean":"2024-09-17T04:11:40.747723+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:11:40.747723+0000","last_undegraded":"2024-09-17T04:11:40.747723+0000","last_fullsized":"2024-09-17T04:11:40.747723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:12.261102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'43","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:41.582824+0000","last_change":"2024-09-17T04:09:44.490721+0000","last_active":"2024-09-17T04:11:41.582824+0000","last_peered":"2024-09-17T04:11:41.582824+0000","last_clean":"2024-09-17T04:11:41.582824+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:11:41.582824+0000","last_undegraded":"2024-09-17T04:11:41.582824+0000","last_fullsized":"2024-09-17T04:11:41.582824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:31.917568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.488561+0000","last_change":"2024-09-17T04:09:40.349550+0000","last_active":"2024-09-17T04:11:43.488561+0000","last_peered":"2024-09-17T04:11:43.488561+0000","last_clean":"2024-09-17T04:11:43.488561+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:11:43.488561+0000","last_undegraded":"2024-09-17T04:11:43.488561+0000","last_fullsized":"2024-09-17T04:11:43.488561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:43.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.483640+0000","last_change":"2024-09-17T04:09:39.340012+0000","last_active":"2024-09-17T04:11:36.483640+0000","last_peered":"2024-09-17T04:11:36.483640+0000","last_clean":"2024-09-17T04:11:36.483640+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:36.483640+0000","last_undegraded":"2024-09-17T04:11:36.483640+0000","last_fullsized":"2024-09-17T04:11:36.483640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'50","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.729097+0000","last_change":"2024-09-17T04:09:44.387188+0000","last_active":"2024-09-17T04:11:40.729097+0000","last_peered":"2024-09-17T04:11:40.729097+0000","last_clean":"2024-09-17T04:11:40.729097+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:11:40.729097+0000","last_undegraded":"2024-09-17T04:11:40.729097+0000","last_fullsized":"2024-09-17T04:11:40.729097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:16.315710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'65","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.720993+0000","last_change":"2024-09-17T04:09:40.344744+0000","last_active":"2024-09-17T04:11:42.720993+0000","last_peered":"2024-09-17T04:11:42.720993+0000","last_clean":"2024-09-17T04:11:42.720993+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:42.720993+0000","last_undegraded":"2024-09-17T04:11:42.720993+0000","last_fullsized":"2024-09-17T04:11:42.720993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:50.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.500242+0000","last_change":"2024-09-17T04:09:39.342537+0000","last_active":"2024-09-17T04:11:36.500242+0000","last_peered":"2024-09-17T04:11:36.500242+0000","last_clean":"2024-09-17T04:11:36.500242+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:36.500242+0000","last_undegraded":"2024-09-17T04:11:36.500242+0000","last_fullsized":"2024-09-17T04:11:36.500242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:28.659484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'29","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:37.400201+0000","last_change":"2024-09-17T04:09:39.341078+0000","last_active":"2024-09-17T04:11:37.400201+0000","last_peered":"2024-09-17T04:11:37.400201+0000","last_clean":"2024-09-17T04:11:37.400201+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:37.400201+0000","last_undegraded":"2024-09-17T04:11:37.400201+0000","last_fullsized":"2024-09-17T04:11:37.400201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719121+0000","last_change":"2024-09-17T04:09:40.341071+0000","last_active":"2024-09-17T04:11:42.719121+0000","last_peered":"2024-09-17T04:11:42.719121+0000","last_clean":"2024-09-17T04:11:42.719121+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:42.719121+0000","last_undegraded":"2024-09-17T04:11:42.719121+0000","last_fullsized":"2024-09-17T04:11:42.719121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'36","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.747899+0000","last_change":"2024-09-17T04:10:20.525430+0000","last_active":"2024-09-17T04:11:40.747899+0000","last_peered":"2024-09-17T04:11:40.747899+0000","last_clean":"2024-09-17T04:11:40.747899+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:40.747899+0000","last_undegraded":"2024-09-17T04:11:40.747899+0000","last_fullsized":"2024-09-17T04:11:40.747899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:25.125740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1527,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:36.512367+0000","last_change":"2024-09-17T04:09:39.342613+0000","last_active":"2024-09-17T04:11:36.512367+0000","last_peered":"2024-09-17T04:11:36.512367+0000","last_clean":"2024-09-17T04:11:36.512367+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:36.512367+0000","last_undegraded":"2024-09-17T04:11:36.512367+0000","last_fullsized":"2024-09-17T04:11:36.512367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:38.311278+0000","last_clean_scrub_stamp":"2024-09-17T04:09:38.311278+0000","objects_scrubbed":0,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:56.278747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704062+0000","last_change":"2024-09-17T04:09:40.346135+0000","last_active":"2024-09-17T04:11:42.704062+0000","last_peered":"2024-09-17T04:11:42.704062+0000","last_clean":"2024-09-17T04:11:42.704062+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:42.704062+0000","last_undegraded":"2024-09-17T04:11:42.704062+0000","last_fullsized":"2024-09-17T04:11:42.704062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:43.953949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742674+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:11:40.742674+0000","last_peered":"2024-09-17T04:11:40.742674+0000","last_clean":"2024-09-17T04:11:40.742674+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:11:40.742674+0000","last_undegraded":"2024-09-17T04:11:40.742674+0000","last_fullsized":"2024-09-17T04:11:40.742674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'69","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486280+0000","last_change":"2024-09-17T04:09:40.361021+0000","last_active":"2024-09-17T04:11:43.486280+0000","last_peered":"2024-09-17T04:11:43.486280+0000","last_clean":"2024-09-17T04:11:43.486280+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:43.486280+0000","last_undegraded":"2024-09-17T04:11:43.486280+0000","last_fullsized":"2024-09-17T04:11:43.486280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:53.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'59","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487056+0000","last_change":"2024-09-17T04:09:40.340942+0000","last_active":"2024-09-17T04:11:43.487056+0000","last_peered":"2024-09-17T04:11:43.487056+0000","last_clean":"2024-09-17T04:11:43.487056+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:43.487056+0000","last_undegraded":"2024-09-17T04:11:43.487056+0000","last_fullsized":"2024-09-17T04:11:43.487056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:46.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'58","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715043+0000","last_change":"2024-09-17T04:09:40.352917+0000","last_active":"2024-09-17T04:11:42.715043+0000","last_peered":"2024-09-17T04:11:42.715043+0000","last_clean":"2024-09-17T04:11:42.715043+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:11:42.715043+0000","last_undegraded":"2024-09-17T04:11:42.715043+0000","last_fullsized":"2024-09-17T04:11:42.715043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'52","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486822+0000","last_change":"2024-09-17T04:09:40.349299+0000","last_active":"2024-09-17T04:11:43.486822+0000","last_peered":"2024-09-17T04:11:43.486822+0000","last_clean":"2024-09-17T04:11:43.486822+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:43.486822+0000","last_undegraded":"2024-09-17T04:11:43.486822+0000","last_fullsized":"2024-09-17T04:11:43.486822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.719345+0000","last_change":"2024-09-17T04:09:40.358240+0000","last_active":"2024-09-17T04:11:42.719345+0000","last_peered":"2024-09-17T04:11:42.719345+0000","last_clean":"2024-09-17T04:11:42.719345+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:42.719345+0000","last_undegraded":"2024-09-17T04:11:42.719345+0000","last_fullsized":"2024-09-17T04:11:42.719345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:36.618401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'37","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.708730+0000","last_change":"2024-09-17T04:09:40.354825+0000","last_active":"2024-09-17T04:11:42.708730+0000","last_peered":"2024-09-17T04:11:42.708730+0000","last_clean":"2024-09-17T04:11:42.708730+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:42.708730+0000","last_undegraded":"2024-09-17T04:11:42.708730+0000","last_fullsized":"2024-09-17T04:11:42.708730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:33.111639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'66","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718035+0000","last_change":"2024-09-17T04:09:40.360285+0000","last_active":"2024-09-17T04:11:42.718035+0000","last_peered":"2024-09-17T04:11:42.718035+0000","last_clean":"2024-09-17T04:11:42.718035+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:42.718035+0000","last_undegraded":"2024-09-17T04:11:42.718035+0000","last_fullsized":"2024-09-17T04:11:42.718035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.718786+0000","last_change":"2024-09-17T04:09:40.357902+0000","last_active":"2024-09-17T04:11:42.718786+0000","last_peered":"2024-09-17T04:11:42.718786+0000","last_clean":"2024-09-17T04:11:42.718786+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:42.718786+0000","last_undegraded":"2024-09-17T04:11:42.718786+0000","last_fullsized":"2024-09-17T04:11:42.718786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:16.991141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'49","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714044+0000","last_change":"2024-09-17T04:09:40.351643+0000","last_active":"2024-09-17T04:11:42.714044+0000","last_peered":"2024-09-17T04:11:42.714044+0000","last_clean":"2024-09-17T04:11:42.714044+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:42.714044+0000","last_undegraded":"2024-09-17T04:11:42.714044+0000","last_fullsized":"2024-09-17T04:11:42.714044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:46.145850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.485921+0000","last_change":"2024-09-17T04:09:40.357800+0000","last_active":"2024-09-17T04:11:43.485921+0000","last_peered":"2024-09-17T04:11:43.485921+0000","last_clean":"2024-09-17T04:11:43.485921+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:11:43.485921+0000","last_undegraded":"2024-09-17T04:11:43.485921+0000","last_fullsized":"2024-09-17T04:11:43.485921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:12.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716464+0000","last_change":"2024-09-17T04:09:40.356103+0000","last_active":"2024-09-17T04:11:42.716464+0000","last_peered":"2024-09-17T04:11:42.716464+0000","last_clean":"2024-09-17T04:11:42.716464+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:11:42.716464+0000","last_undegraded":"2024-09-17T04:11:42.716464+0000","last_fullsized":"2024-09-17T04:11:42.716464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'63","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.729269+0000","last_change":"2024-09-17T04:09:40.359737+0000","last_active":"2024-09-17T04:11:42.729269+0000","last_peered":"2024-09-17T04:11:42.729269+0000","last_clean":"2024-09-17T04:11:42.729269+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:11:42.729269+0000","last_undegraded":"2024-09-17T04:11:42.729269+0000","last_fullsized":"2024-09-17T04:11:42.729269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.224695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'62","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712957+0000","last_change":"2024-09-17T04:09:40.354746+0000","last_active":"2024-09-17T04:11:42.712957+0000","last_peered":"2024-09-17T04:11:42.712957+0000","last_clean":"2024-09-17T04:11:42.712957+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:11:42.712957+0000","last_undegraded":"2024-09-17T04:11:42.712957+0000","last_fullsized":"2024-09-17T04:11:42.712957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:27.479229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.725600+0000","last_change":"2024-09-17T04:09:40.359026+0000","last_active":"2024-09-17T04:11:42.725600+0000","last_peered":"2024-09-17T04:11:42.725600+0000","last_clean":"2024-09-17T04:11:42.725600+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:11:42.725600+0000","last_undegraded":"2024-09-17T04:11:42.725600+0000","last_fullsized":"2024-09-17T04:11:42.725600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:06.147980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'58","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.716344+0000","last_change":"2024-09-17T04:09:40.355505+0000","last_active":"2024-09-17T04:11:42.716344+0000","last_peered":"2024-09-17T04:11:42.716344+0000","last_clean":"2024-09-17T04:11:42.716344+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:42.716344+0000","last_undegraded":"2024-09-17T04:11:42.716344+0000","last_fullsized":"2024-09-17T04:11:42.716344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.866744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'55","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.704448+0000","last_change":"2024-09-17T04:10:20.775054+0000","last_active":"2024-09-17T04:11:42.704448+0000","last_peered":"2024-09-17T04:11:42.704448+0000","last_clean":"2024-09-17T04:11:42.704448+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:42.704448+0000","last_undegraded":"2024-09-17T04:11:42.704448+0000","last_fullsized":"2024-09-17T04:11:42.704448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715936+0000","last_change":"2024-09-17T04:09:40.346290+0000","last_active":"2024-09-17T04:11:42.715936+0000","last_peered":"2024-09-17T04:11:42.715936+0000","last_clean":"2024-09-17T04:11:42.715936+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:11:42.715936+0000","last_undegraded":"2024-09-17T04:11:42.715936+0000","last_fullsized":"2024-09-17T04:11:42.715936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:21.085479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'53","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.712340+0000","last_change":"2024-09-17T04:09:40.342706+0000","last_active":"2024-09-17T04:11:42.712340+0000","last_peered":"2024-09-17T04:11:42.712340+0000","last_clean":"2024-09-17T04:11:42.712340+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:42.712340+0000","last_undegraded":"2024-09-17T04:11:42.712340+0000","last_fullsized":"2024-09-17T04:11:42.712340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.742545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'59","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714155+0000","last_change":"2024-09-17T04:09:40.343953+0000","last_active":"2024-09-17T04:11:42.714155+0000","last_peered":"2024-09-17T04:11:42.714155+0000","last_clean":"2024-09-17T04:11:42.714155+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:42.714155+0000","last_undegraded":"2024-09-17T04:11:42.714155+0000","last_fullsized":"2024-09-17T04:11:42.714155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.731349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'48","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486743+0000","last_change":"2024-09-17T04:09:40.356221+0000","last_active":"2024-09-17T04:11:43.486743+0000","last_peered":"2024-09-17T04:11:43.486743+0000","last_clean":"2024-09-17T04:11:43.486743+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:11:43.486743+0000","last_undegraded":"2024-09-17T04:11:43.486743+0000","last_fullsized":"2024-09-17T04:11:43.486743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.512618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'44","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.710056+0000","last_change":"2024-09-17T04:09:40.353612+0000","last_active":"2024-09-17T04:11:42.710056+0000","last_peered":"2024-09-17T04:11:42.710056+0000","last_clean":"2024-09-17T04:11:42.710056+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:42.710056+0000","last_undegraded":"2024-09-17T04:11:42.710056+0000","last_fullsized":"2024-09-17T04:11:42.710056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:39.503738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'50","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.714035+0000","last_change":"2024-09-17T04:09:40.353595+0000","last_active":"2024-09-17T04:11:42.714035+0000","last_peered":"2024-09-17T04:11:42.714035+0000","last_clean":"2024-09-17T04:11:42.714035+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:11:42.714035+0000","last_undegraded":"2024-09-17T04:11:42.714035+0000","last_fullsized":"2024-09-17T04:11:42.714035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:48.297424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'53","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.715797+0000","last_change":"2024-09-17T04:09:40.352728+0000","last_active":"2024-09-17T04:11:42.715797+0000","last_peered":"2024-09-17T04:11:42.715797+0000","last_clean":"2024-09-17T04:11:42.715797+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:11:42.715797+0000","last_undegraded":"2024-09-17T04:11:42.715797+0000","last_fullsized":"2024-09-17T04:11:42.715797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.977963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.728359+0000","last_change":"2024-09-17T04:09:40.364935+0000","last_active":"2024-09-17T04:11:42.728359+0000","last_peered":"2024-09-17T04:11:42.728359+0000","last_clean":"2024-09-17T04:11:42.728359+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:11:42.728359+0000","last_undegraded":"2024-09-17T04:11:42.728359+0000","last_fullsized":"2024-09-17T04:11:42.728359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.877307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.717094+0000","last_change":"2024-09-17T04:09:40.352863+0000","last_active":"2024-09-17T04:11:42.717094+0000","last_peered":"2024-09-17T04:11:42.717094+0000","last_clean":"2024-09-17T04:11:42.717094+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:11:42.717094+0000","last_undegraded":"2024-09-17T04:11:42.717094+0000","last_fullsized":"2024-09-17T04:11:42.717094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:05.403640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'54","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726049+0000","last_change":"2024-09-17T04:09:40.360043+0000","last_active":"2024-09-17T04:11:42.726049+0000","last_peered":"2024-09-17T04:11:42.726049+0000","last_clean":"2024-09-17T04:11:42.726049+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:11:42.726049+0000","last_undegraded":"2024-09-17T04:11:42.726049+0000","last_fullsized":"2024-09-17T04:11:42.726049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:38.847379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'51","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487078+0000","last_change":"2024-09-17T04:09:40.344672+0000","last_active":"2024-09-17T04:11:43.487078+0000","last_peered":"2024-09-17T04:11:43.487078+0000","last_clean":"2024-09-17T04:11:43.487078+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:11:43.487078+0000","last_undegraded":"2024-09-17T04:11:43.487078+0000","last_fullsized":"2024-09-17T04:11:43.487078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.676077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726135+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:11:42.726135+0000","last_peered":"2024-09-17T04:11:42.726135+0000","last_clean":"2024-09-17T04:11:42.726135+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:11:42.726135+0000","last_undegraded":"2024-09-17T04:11:42.726135+0000","last_fullsized":"2024-09-17T04:11:42.726135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'40","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.486800+0000","last_change":"2024-09-17T04:09:40.354914+0000","last_active":"2024-09-17T04:11:43.486800+0000","last_peered":"2024-09-17T04:11:43.486800+0000","last_clean":"2024-09-17T04:11:43.486800+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:11:43.486800+0000","last_undegraded":"2024-09-17T04:11:43.486800+0000","last_fullsized":"2024-09-17T04:11:43.486800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:18.409305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'55","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.487655+0000","last_change":"2024-09-17T04:09:40.346576+0000","last_active":"2024-09-17T04:11:43.487655+0000","last_peered":"2024-09-17T04:11:43.487655+0000","last_clean":"2024-09-17T04:11:43.487655+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:43.487655+0000","last_undegraded":"2024-09-17T04:11:43.487655+0000","last_fullsized":"2024-09-17T04:11:43.487655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'43","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:43.489457+0000","last_change":"2024-09-17T04:09:40.347942+0000","last_active":"2024-09-17T04:11:43.489457+0000","last_peered":"2024-09-17T04:11:43.489457+0000","last_clean":"2024-09-17T04:11:43.489457+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:43.489457+0000","last_undegraded":"2024-09-17T04:11:43.489457+0000","last_fullsized":"2024-09-17T04:11:43.489457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:03.101730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'48","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.727382+0000","last_change":"2024-09-17T04:09:40.362704+0000","last_active":"2024-09-17T04:11:42.727382+0000","last_peered":"2024-09-17T04:11:42.727382+0000","last_clean":"2024-09-17T04:11:42.727382+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:11:42.727382+0000","last_undegraded":"2024-09-17T04:11:42.727382+0000","last_fullsized":"2024-09-17T04:11:42.727382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:52.291994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30914888,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":3054,"num_write_kb":32945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61890560,"data_stored":61829776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3749,"ondisk_log_size":3749,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53772,"kb_used_data":18428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318068,"statfs":{"total":96636764160,"available":96581701632,"internally_reserved":0,"allocated":18870272,"data_stored":18678423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49100,"kb_used_data":13756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322740,"statfs":{"total":96636764160,"available":96586485760,"internally_reserved":0,"allocated":14086144,"data_stored":13893841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70508,"kb_used_data":12956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94301332,"statfs":{"total":96636764160,"available":96564563968,"internally_reserved":0,"allocated":13266944,"data_stored":13077537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":493953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40268,"kb_used_data":9084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331572,"statfs":{"total":96636764160,"available":96595529728,"internally_reserved":0,"allocated":9302016,"data_stored":9105074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13778944,"data_stored":13768381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17969152,"data_stored":17962595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:11:51.426 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.427 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.428 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.429 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.430 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.431 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T04:09:29.920232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=29, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.432 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.433 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.434 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.435 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.436 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-17T04:09:38.311278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.437 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.438 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.439 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.440 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:11:51.441 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T04:12:05.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:05.166 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:11.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:12:11.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/1699652251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd40ca610 msgr2=0x7f3dd40cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:11.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/1699652251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd40ca610 0x7f3dd40cdb90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4005fd0 tx=0x7f3dc402aa90 comp rx=0 tx=0).stop 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/1699652251 shutdown_connections 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/1699652251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd4073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/1699652251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd40ca610 0x7f3dd40cdb90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/1699652251 >> 172.21.15.104:0/1699652251 conn(0x7f3dd40cca40 msgr2=0x7f3dd40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/1699652251 shutdown_connections 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.570+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/1699652251 wait complete. 2024-09-17T04:12:11.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.572+0000 7f3dd9fb0640 1 Processor -- start 2024-09-17T04:12:11.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.572+0000 7f3dd9fb0640 1 -- start start 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.573+0000 7f3dd9fb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dd40ca610 0x7f3dd409bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd409c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd406e180 con 0x7f3dd4074360 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd406e000 con 0x7f3dd40ca610 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd406e300 con 0x7f3dd40ce0d0 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:11.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55572/0 (socket says 172.21.15.104:55572) 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 -- 172.21.15.104:0/3155840006 learned_addr learned my addr 172.21.15.104:0/3155840006 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd3fff640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd409c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd2ffd640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dd40ca610 0x7f3dd409bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 -- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 msgr2=0x7f3dd409c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd409c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 -- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dd40ca610 msgr2=0x7f3dd409bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dd40ca610 0x7f3dd409bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 -- 172.21.15.104:0/3155840006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd415bfc0 con 0x7f3dd4074360 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd3fff640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd409c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd37fe640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006010 tx=0x7f3dc4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4044070 con 0x7f3dd4074360 2024-09-17T04:12:11.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dc4004250 con 0x7f3dd4074360 2024-09-17T04:12:11.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd409cde0 con 0x7f3dd4074360 2024-09-17T04:12:11.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4004660 con 0x7f3dd4074360 2024-09-17T04:12:11.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.574+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd409d3a0 con 0x7f3dd4074360 2024-09-17T04:12:11.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.575+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd406acf0 con 0x7f3dd4074360 2024-09-17T04:12:11.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.576+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dc4036400 con 0x7f3dd4074360 2024-09-17T04:12:11.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.577+0000 7f3dbbfff640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 0x7f3dc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:11.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.577+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f3dc40bc090 con 0x7f3dd4074360 2024-09-17T04:12:11.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.577+0000 7f3dd2ffd640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 0x7f3dc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:11.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.578+0000 7f3dd2ffd640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 0x7f3dc007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80058c0 tx=0x7f3dc8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:11.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.582+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3dd406acf0 con 0x7f3dd4074360 2024-09-17T04:12:11.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.753+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dd4075050 con 0x7f3dc0078b90 2024-09-17T04:12:11.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.759+0000 7f3dbbfff640 1 -- 172.21.15.104:0/3155840006 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333774 (secure 0 0 0) 0x7f3dd4075050 con 0x7f3dc0078b90 2024-09-17T04:12:11.763 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:12:11.765 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 msgr2=0x7f3dc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 0x7f3dc007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80058c0 tx=0x7f3dc8005850 comp rx=0 tx=0).stop 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 msgr2=0x7f3dd40b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4006010 tx=0x7f3dc4003ce0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 shutdown_connections 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f3dc0078b90 0x7f3dc007b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dd40ca610 0x7f3dd409bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dd40ce0d0 0x7f3dd409c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 --2- 172.21.15.104:0/3155840006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dd4074360 0x7f3dd40b56f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:11.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 >> 172.21.15.104:0/3155840006 conn(0x7f3dd40cca40 msgr2=0x7f3dd415e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:11.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 shutdown_connections 2024-09-17T04:12:11.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:11.763+0000 7f3dd9fb0640 1 -- 172.21.15.104:0/3155840006 wait complete. 2024-09-17T04:12:11.774 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-17T04:12:11.384021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31506394,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":93,"num_read_kb":434,"num_write":3156,"num_write_kb":34575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8556,"ondisk_log_size":8556,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356480,"kb_used_data":64000,"kb_used_omap":12,"kb_used_meta":292339,"kb_avail":754618240,"statfs":{"total":773094113280,"available":772729077760,"internally_reserved":0,"allocated":65536000,"data_stored":64016468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":299355696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003985"},"pg_stats":[{"pgid":"2.1f","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.712818+0000","last_change":"2024-09-17T04:11:51.712818+0000","last_active":"2024-09-17T04:11:51.712818+0000","last_peered":"2024-09-17T04:11:51.712818+0000","last_clean":"2024-09-17T04:11:51.712818+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:51.712818+0000","last_undegraded":"2024-09-17T04:11:51.712818+0000","last_fullsized":"2024-09-17T04:11:51.712818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.712746+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.712746+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.712746+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:19.119908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'46","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.219551+0000","last_change":"2024-09-17T04:11:57.219551+0000","last_active":"2024-09-17T04:11:57.219551+0000","last_peered":"2024-09-17T04:11:57.219551+0000","last_clean":"2024-09-17T04:11:57.219551+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:57.219551+0000","last_undegraded":"2024-09-17T04:11:57.219551+0000","last_fullsized":"2024-09-17T04:11:57.219551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:57.219450+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:57.219450+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.219450+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:46.727616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'49","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:08.300711+0000","last_change":"2024-09-17T04:12:08.300636+0000","last_active":"2024-09-17T04:12:08.300711+0000","last_peered":"2024-09-17T04:12:08.300711+0000","last_clean":"2024-09-17T04:12:08.300711+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:12:08.300711+0000","last_undegraded":"2024-09-17T04:12:08.300711+0000","last_fullsized":"2024-09-17T04:12:08.300711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:12:08.300517+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:12:08.300517+0000","last_clean_scrub_stamp":"2024-09-17T04:12:08.300517+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:42.213619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'32","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.237280+0000","last_change":"2024-09-17T04:11:50.237280+0000","last_active":"2024-09-17T04:11:50.237280+0000","last_peered":"2024-09-17T04:11:50.237280+0000","last_clean":"2024-09-17T04:11:50.237280+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:50.237280+0000","last_undegraded":"2024-09-17T04:11:50.237280+0000","last_fullsized":"2024-09-17T04:11:50.237280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2024-09-17T04:11:50.237181+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2024-09-17T04:11:50.237181+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.237181+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:42.136321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'57","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.718816+0000","last_change":"2024-09-17T04:11:55.718816+0000","last_active":"2024-09-17T04:11:55.718816+0000","last_peered":"2024-09-17T04:11:55.718816+0000","last_clean":"2024-09-17T04:11:55.718816+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:55.718816+0000","last_undegraded":"2024-09-17T04:11:55.718816+0000","last_fullsized":"2024-09-17T04:11:55.718816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-09-17T04:11:55.718718+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-09-17T04:11:55.718718+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.718718+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:44.473931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.909627+0000","last_change":"2024-09-17T04:12:00.909551+0000","last_active":"2024-09-17T04:12:00.909627+0000","last_peered":"2024-09-17T04:12:00.909627+0000","last_clean":"2024-09-17T04:12:00.909627+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:12:00.909627+0000","last_undegraded":"2024-09-17T04:12:00.909627+0000","last_fullsized":"2024-09-17T04:12:00.909627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:00.909456+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:00.909456+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.909456+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:19.408140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'61","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.725595+0000","last_change":"2024-09-17T04:11:56.725489+0000","last_active":"2024-09-17T04:11:56.725595+0000","last_peered":"2024-09-17T04:11:56.725595+0000","last_clean":"2024-09-17T04:11:56.725595+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:56.725595+0000","last_undegraded":"2024-09-17T04:11:56.725595+0000","last_fullsized":"2024-09-17T04:11:56.725595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'61","last_scrub_stamp":"2024-09-17T04:11:56.725352+0000","last_deep_scrub":"29'61","last_deep_scrub_stamp":"2024-09-17T04:11:56.725352+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.725352+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:18.644323+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5380239,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'50","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.969850+0000","last_change":"2024-09-17T04:11:57.969850+0000","last_active":"2024-09-17T04:11:57.969850+0000","last_peered":"2024-09-17T04:11:57.969850+0000","last_clean":"2024-09-17T04:11:57.969850+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:57.969850+0000","last_undegraded":"2024-09-17T04:11:57.969850+0000","last_fullsized":"2024-09-17T04:11:57.969850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:57.969748+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:57.969748+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.969748+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:49.978855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'44","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.854652+0000","last_change":"2024-09-17T04:12:03.854652+0000","last_active":"2024-09-17T04:12:03.854652+0000","last_peered":"2024-09-17T04:12:03.854652+0000","last_clean":"2024-09-17T04:12:03.854652+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:12:03.854652+0000","last_undegraded":"2024-09-17T04:12:03.854652+0000","last_fullsized":"2024-09-17T04:12:03.854652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:12:03.854558+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:12:03.854558+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.854558+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:59.051388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.710356+0000","last_change":"2024-09-17T04:11:55.710287+0000","last_active":"2024-09-17T04:11:55.710356+0000","last_peered":"2024-09-17T04:11:55.710356+0000","last_clean":"2024-09-17T04:11:55.710356+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:55.710356+0000","last_undegraded":"2024-09-17T04:11:55.710356+0000","last_fullsized":"2024-09-17T04:11:55.710356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-17T04:11:55.710179+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-17T04:11:55.710179+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.710179+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:05.753812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'58","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.930621+0000","last_change":"2024-09-17T04:11:58.930621+0000","last_active":"2024-09-17T04:11:58.930621+0000","last_peered":"2024-09-17T04:11:58.930621+0000","last_clean":"2024-09-17T04:11:58.930621+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:58.930621+0000","last_undegraded":"2024-09-17T04:11:58.930621+0000","last_fullsized":"2024-09-17T04:11:58.930621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:58.930508+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:58.930508+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.930508+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:22.214027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'40","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.908997+0000","last_change":"2024-09-17T04:12:01.908997+0000","last_active":"2024-09-17T04:12:01.908997+0000","last_peered":"2024-09-17T04:12:01.908997+0000","last_clean":"2024-09-17T04:12:01.908997+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:12:01.908997+0000","last_undegraded":"2024-09-17T04:12:01.908997+0000","last_fullsized":"2024-09-17T04:12:01.908997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:01.908902+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:01.908902+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.908902+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:14.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'42","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.141294+0000","last_change":"2024-09-17T04:11:57.141294+0000","last_active":"2024-09-17T04:11:57.141294+0000","last_peered":"2024-09-17T04:11:57.141294+0000","last_clean":"2024-09-17T04:11:57.141294+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:57.141294+0000","last_undegraded":"2024-09-17T04:11:57.141294+0000","last_fullsized":"2024-09-17T04:11:57.141294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:57.141152+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:57.141152+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.141152+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:12.837964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'231","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.760428+0000","last_change":"2024-09-17T04:11:52.760361+0000","last_active":"2024-09-17T04:11:52.760428+0000","last_peered":"2024-09-17T04:11:52.760428+0000","last_clean":"2024-09-17T04:11:52.760428+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:52.760428+0000","last_undegraded":"2024-09-17T04:11:52.760428+0000","last_fullsized":"2024-09-17T04:11:52.760428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'231","last_scrub_stamp":"2024-09-17T04:11:52.760268+0000","last_deep_scrub":"29'231","last_deep_scrub_stamp":"2024-09-17T04:11:52.760268+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.760268+0000","objects_scrubbed":2,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.910543+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'41","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.944788+0000","last_change":"2024-09-17T04:11:58.944788+0000","last_active":"2024-09-17T04:11:58.944788+0000","last_peered":"2024-09-17T04:11:58.944788+0000","last_clean":"2024-09-17T04:11:58.944788+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:58.944788+0000","last_undegraded":"2024-09-17T04:11:58.944788+0000","last_fullsized":"2024-09-17T04:11:58.944788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-09-17T04:11:58.944696+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-09-17T04:11:58.944696+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.944696+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.434019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.181753+0000","last_change":"2024-09-17T04:11:55.181639+0000","last_active":"2024-09-17T04:11:55.181753+0000","last_peered":"2024-09-17T04:11:55.181753+0000","last_clean":"2024-09-17T04:11:55.181753+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:55.181753+0000","last_undegraded":"2024-09-17T04:11:55.181753+0000","last_fullsized":"2024-09-17T04:11:55.181753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:55.181515+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:55.181515+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.181515+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:05.684333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.600576+0000","last_change":"2024-09-17T04:11:50.600471+0000","last_active":"2024-09-17T04:11:50.600576+0000","last_peered":"2024-09-17T04:11:50.600576+0000","last_clean":"2024-09-17T04:11:50.600576+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:50.600576+0000","last_undegraded":"2024-09-17T04:11:50.600576+0000","last_fullsized":"2024-09-17T04:11:50.600576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-09-17T04:11:50.600349+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-09-17T04:11:50.600349+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.600349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.425528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.911083+0000","last_change":"2024-09-17T04:11:57.911000+0000","last_active":"2024-09-17T04:11:57.911083+0000","last_peered":"2024-09-17T04:11:57.911083+0000","last_clean":"2024-09-17T04:11:57.911083+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:57.911083+0000","last_undegraded":"2024-09-17T04:11:57.911083+0000","last_fullsized":"2024-09-17T04:11:57.911083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:57.910896+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:57.910896+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.910896+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:08.249762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.182329+0000","last_change":"2024-09-17T04:11:52.182237+0000","last_active":"2024-09-17T04:11:52.182329+0000","last_peered":"2024-09-17T04:11:52.182329+0000","last_clean":"2024-09-17T04:11:52.182329+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:52.182329+0000","last_undegraded":"2024-09-17T04:11:52.182329+0000","last_fullsized":"2024-09-17T04:11:52.182329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:52.182115+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:52.182115+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.182115+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:04.424749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.612560+0000","last_change":"2024-09-17T04:11:51.612560+0000","last_active":"2024-09-17T04:11:51.612560+0000","last_peered":"2024-09-17T04:11:51.612560+0000","last_clean":"2024-09-17T04:11:51.612560+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:51.612560+0000","last_undegraded":"2024-09-17T04:11:51.612560+0000","last_fullsized":"2024-09-17T04:11:51.612560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.612431+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.612431+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.612431+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:25.869131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'40","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.575161+0000","last_change":"2024-09-17T04:12:03.575161+0000","last_active":"2024-09-17T04:12:03.575161+0000","last_peered":"2024-09-17T04:12:03.575161+0000","last_clean":"2024-09-17T04:12:03.575161+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:12:03.575161+0000","last_undegraded":"2024-09-17T04:12:03.575161+0000","last_fullsized":"2024-09-17T04:12:03.575161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:03.575062+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:03.575062+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.575062+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:41.193729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.959649+0000","last_change":"2024-09-17T04:11:50.959581+0000","last_active":"2024-09-17T04:11:50.959649+0000","last_peered":"2024-09-17T04:11:50.959649+0000","last_clean":"2024-09-17T04:11:50.959649+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:50.959649+0000","last_undegraded":"2024-09-17T04:11:50.959649+0000","last_fullsized":"2024-09-17T04:11:50.959649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:50.959454+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:50.959454+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.959454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:27.670230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.758559+0000","last_change":"2024-09-17T04:11:57.758559+0000","last_active":"2024-09-17T04:11:57.758559+0000","last_peered":"2024-09-17T04:11:57.758559+0000","last_clean":"2024-09-17T04:11:57.758559+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:57.758559+0000","last_undegraded":"2024-09-17T04:11:57.758559+0000","last_fullsized":"2024-09-17T04:11:57.758559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:57.758443+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:57.758443+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.758443+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.213648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'42","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.933578+0000","last_change":"2024-09-17T04:11:59.933578+0000","last_active":"2024-09-17T04:11:59.933578+0000","last_peered":"2024-09-17T04:11:59.933578+0000","last_clean":"2024-09-17T04:11:59.933578+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:59.933578+0000","last_undegraded":"2024-09-17T04:11:59.933578+0000","last_fullsized":"2024-09-17T04:11:59.933578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:59.933470+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:59.933470+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.933470+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:09.665628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.647481+0000","last_change":"2024-09-17T04:11:49.647394+0000","last_active":"2024-09-17T04:11:49.647481+0000","last_peered":"2024-09-17T04:11:49.647481+0000","last_clean":"2024-09-17T04:11:49.647481+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:49.647481+0000","last_undegraded":"2024-09-17T04:11:49.647481+0000","last_fullsized":"2024-09-17T04:11:49.647481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:49.647318+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:49.647318+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.647318+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:44.035580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.239492+0000","last_change":"2024-09-17T04:11:54.239492+0000","last_active":"2024-09-17T04:11:54.239492+0000","last_peered":"2024-09-17T04:11:54.239492+0000","last_clean":"2024-09-17T04:11:54.239492+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:54.239492+0000","last_undegraded":"2024-09-17T04:11:54.239492+0000","last_fullsized":"2024-09-17T04:11:54.239492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-17T04:11:54.239402+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-17T04:11:54.239402+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.239402+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:48.627663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'46","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.927409+0000","last_change":"2024-09-17T04:11:55.927409+0000","last_active":"2024-09-17T04:11:55.927409+0000","last_peered":"2024-09-17T04:11:55.927409+0000","last_clean":"2024-09-17T04:11:55.927409+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:55.927409+0000","last_undegraded":"2024-09-17T04:11:55.927409+0000","last_fullsized":"2024-09-17T04:11:55.927409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:55.927273+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:55.927273+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.927273+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:27.221742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.225252+0000","last_change":"2024-09-17T04:11:54.225252+0000","last_active":"2024-09-17T04:11:54.225252+0000","last_peered":"2024-09-17T04:11:54.225252+0000","last_clean":"2024-09-17T04:11:54.225252+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:54.225252+0000","last_undegraded":"2024-09-17T04:11:54.225252+0000","last_fullsized":"2024-09-17T04:11:54.225252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:54.225152+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:54.225152+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.225152+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:28.017175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'51","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.591009+0000","last_change":"2024-09-17T04:11:48.590908+0000","last_active":"2024-09-17T04:11:48.591009+0000","last_peered":"2024-09-17T04:11:48.591009+0000","last_clean":"2024-09-17T04:11:48.591009+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:48.591009+0000","last_undegraded":"2024-09-17T04:11:48.591009+0000","last_fullsized":"2024-09-17T04:11:48.591009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:48.590791+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:48.590791+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.590791+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:04.333328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'51","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.228787+0000","last_change":"2024-09-17T04:12:04.228787+0000","last_active":"2024-09-17T04:12:04.228787+0000","last_peered":"2024-09-17T04:12:04.228787+0000","last_clean":"2024-09-17T04:12:04.228787+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:12:04.228787+0000","last_undegraded":"2024-09-17T04:12:04.228787+0000","last_fullsized":"2024-09-17T04:12:04.228787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:04.228655+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:04.228655+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.228655+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:53.586447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'45","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.658856+0000","last_change":"2024-09-17T04:11:55.658856+0000","last_active":"2024-09-17T04:11:55.658856+0000","last_peered":"2024-09-17T04:11:55.658856+0000","last_clean":"2024-09-17T04:11:55.658856+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:55.658856+0000","last_undegraded":"2024-09-17T04:11:55.658856+0000","last_fullsized":"2024-09-17T04:11:55.658856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:55.658764+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:55.658764+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.658764+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:28.503626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.719967+0000","last_change":"2024-09-17T04:11:51.719967+0000","last_active":"2024-09-17T04:11:51.719967+0000","last_peered":"2024-09-17T04:11:51.719967+0000","last_clean":"2024-09-17T04:11:51.719967+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:51.719967+0000","last_undegraded":"2024-09-17T04:11:51.719967+0000","last_fullsized":"2024-09-17T04:11:51.719967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.719849+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.719849+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.719849+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:46.108110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.629513+0000","last_change":"2024-09-17T04:12:01.629513+0000","last_active":"2024-09-17T04:12:01.629513+0000","last_peered":"2024-09-17T04:12:01.629513+0000","last_clean":"2024-09-17T04:12:01.629513+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:12:01.629513+0000","last_undegraded":"2024-09-17T04:12:01.629513+0000","last_fullsized":"2024-09-17T04:12:01.629513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:01.629416+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:01.629416+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.629416+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:29.265618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'46","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.891005+0000","last_change":"2024-09-17T04:11:54.891005+0000","last_active":"2024-09-17T04:11:54.891005+0000","last_peered":"2024-09-17T04:11:54.891005+0000","last_clean":"2024-09-17T04:11:54.891005+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:54.891005+0000","last_undegraded":"2024-09-17T04:11:54.891005+0000","last_fullsized":"2024-09-17T04:11:54.891005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:54.890896+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:54.890896+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.890896+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:29.453435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.558238+0000","last_change":"2024-09-17T04:11:49.558238+0000","last_active":"2024-09-17T04:11:49.558238+0000","last_peered":"2024-09-17T04:11:49.558238+0000","last_clean":"2024-09-17T04:11:49.558238+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:49.558238+0000","last_undegraded":"2024-09-17T04:11:49.558238+0000","last_fullsized":"2024-09-17T04:11:49.558238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-17T04:11:49.558119+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-17T04:11:49.558119+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.558119+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:48.445243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.626422+0000","last_change":"2024-09-17T04:11:58.626422+0000","last_active":"2024-09-17T04:11:58.626422+0000","last_peered":"2024-09-17T04:11:58.626422+0000","last_clean":"2024-09-17T04:11:58.626422+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:58.626422+0000","last_undegraded":"2024-09-17T04:11:58.626422+0000","last_fullsized":"2024-09-17T04:11:58.626422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:58.626320+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:58.626320+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.626320+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:35.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.943106+0000","last_change":"2024-09-17T04:11:49.943106+0000","last_active":"2024-09-17T04:11:49.943106+0000","last_peered":"2024-09-17T04:11:49.943106+0000","last_clean":"2024-09-17T04:11:49.943106+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:49.943106+0000","last_undegraded":"2024-09-17T04:11:49.943106+0000","last_fullsized":"2024-09-17T04:11:49.943106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:49.942975+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:49.942975+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.942975+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:49.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.993698+0000","last_change":"2024-09-17T04:11:51.993698+0000","last_active":"2024-09-17T04:11:51.993698+0000","last_peered":"2024-09-17T04:11:51.993698+0000","last_clean":"2024-09-17T04:11:51.993698+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:51.993698+0000","last_undegraded":"2024-09-17T04:11:51.993698+0000","last_fullsized":"2024-09-17T04:11:51.993698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:51.993613+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:51.993613+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.993613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:55.828485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.564631+0000","last_change":"2024-09-17T04:12:00.564631+0000","last_active":"2024-09-17T04:12:00.564631+0000","last_peered":"2024-09-17T04:12:00.564631+0000","last_clean":"2024-09-17T04:12:00.564631+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:12:00.564631+0000","last_undegraded":"2024-09-17T04:12:00.564631+0000","last_fullsized":"2024-09-17T04:12:00.564631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:00.564535+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:00.564535+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.564535+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:50.166069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'45","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.660027+0000","last_change":"2024-09-17T04:11:54.660027+0000","last_active":"2024-09-17T04:11:54.660027+0000","last_peered":"2024-09-17T04:11:54.660027+0000","last_clean":"2024-09-17T04:11:54.660027+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:54.660027+0000","last_undegraded":"2024-09-17T04:11:54.660027+0000","last_fullsized":"2024-09-17T04:11:54.660027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:54.659925+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:54.659925+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.659925+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:45.383283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'56","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.857553+0000","last_change":"2024-09-17T04:11:48.857553+0000","last_active":"2024-09-17T04:11:48.857553+0000","last_peered":"2024-09-17T04:11:48.857553+0000","last_clean":"2024-09-17T04:11:48.857553+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:48.857553+0000","last_undegraded":"2024-09-17T04:11:48.857553+0000","last_fullsized":"2024-09-17T04:11:48.857553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2024-09-17T04:11:48.857469+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2024-09-17T04:11:48.857469+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.857469+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:36.227252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":27,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.584663+0000","last_change":"2024-09-17T04:12:02.584663+0000","last_active":"2024-09-17T04:12:02.584663+0000","last_peered":"2024-09-17T04:12:02.584663+0000","last_clean":"2024-09-17T04:12:02.584663+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:12:02.584663+0000","last_undegraded":"2024-09-17T04:12:02.584663+0000","last_fullsized":"2024-09-17T04:12:02.584663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:12:02.584533+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:12:02.584533+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.584533+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:48.426323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.650353+0000","last_change":"2024-09-17T04:11:48.650353+0000","last_active":"2024-09-17T04:11:48.650353+0000","last_peered":"2024-09-17T04:11:48.650353+0000","last_clean":"2024-09-17T04:11:48.650353+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:48.650353+0000","last_undegraded":"2024-09-17T04:11:48.650353+0000","last_fullsized":"2024-09-17T04:11:48.650353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:48.650278+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:48.650278+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.650278+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:58.717786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.746928+0000","last_change":"2024-09-17T04:11:53.746928+0000","last_active":"2024-09-17T04:11:53.746928+0000","last_peered":"2024-09-17T04:11:53.746928+0000","last_clean":"2024-09-17T04:11:53.746928+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:53.746928+0000","last_undegraded":"2024-09-17T04:11:53.746928+0000","last_fullsized":"2024-09-17T04:11:53.746928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:53.746822+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:53.746822+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.746822+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:21.153984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.682059+0000","last_change":"2024-09-17T04:11:58.682059+0000","last_active":"2024-09-17T04:11:58.682059+0000","last_peered":"2024-09-17T04:11:58.682059+0000","last_clean":"2024-09-17T04:11:58.682059+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:58.682059+0000","last_undegraded":"2024-09-17T04:11:58.682059+0000","last_fullsized":"2024-09-17T04:11:58.682059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:11:58.681918+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:11:58.681918+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.681918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:22.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'57","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.917616+0000","last_change":"2024-09-17T04:11:52.917616+0000","last_active":"2024-09-17T04:11:52.917616+0000","last_peered":"2024-09-17T04:11:52.917616+0000","last_clean":"2024-09-17T04:11:52.917616+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:52.917616+0000","last_undegraded":"2024-09-17T04:11:52.917616+0000","last_fullsized":"2024-09-17T04:11:52.917616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-09-17T04:11:52.917516+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-09-17T04:11:52.917516+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.917516+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:48.739475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.014872+0000","last_change":"2024-09-17T04:11:51.014872+0000","last_active":"2024-09-17T04:11:51.014872+0000","last_peered":"2024-09-17T04:11:51.014872+0000","last_clean":"2024-09-17T04:11:51.014872+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:51.014872+0000","last_undegraded":"2024-09-17T04:11:51.014872+0000","last_fullsized":"2024-09-17T04:11:51.014872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-17T04:11:51.014706+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-17T04:11:51.014706+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.014706+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:06.711517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":134,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.727694+0000","last_change":"2024-09-17T04:11:54.727694+0000","last_active":"2024-09-17T04:11:54.727694+0000","last_peered":"2024-09-17T04:11:54.727694+0000","last_clean":"2024-09-17T04:11:54.727694+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:11:54.727694+0000","last_undegraded":"2024-09-17T04:11:54.727694+0000","last_fullsized":"2024-09-17T04:11:54.727694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-09-17T04:11:54.727562+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-09-17T04:11:54.727562+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.727562+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.889563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'35","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.232983+0000","last_change":"2024-09-17T04:12:05.232983+0000","last_active":"2024-09-17T04:12:05.232983+0000","last_peered":"2024-09-17T04:12:05.232983+0000","last_clean":"2024-09-17T04:12:05.232983+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:12:05.232983+0000","last_undegraded":"2024-09-17T04:12:05.232983+0000","last_fullsized":"2024-09-17T04:12:05.232983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-09-17T04:12:05.232864+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-09-17T04:12:05.232864+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.232864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:28.516383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'46","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.755626+0000","last_change":"2024-09-17T04:11:58.755626+0000","last_active":"2024-09-17T04:11:58.755626+0000","last_peered":"2024-09-17T04:11:58.755626+0000","last_clean":"2024-09-17T04:11:58.755626+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:58.755626+0000","last_undegraded":"2024-09-17T04:11:58.755626+0000","last_fullsized":"2024-09-17T04:11:58.755626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:58.755505+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:58.755505+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.755505+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:58.084867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.878523+0000","last_change":"2024-09-17T04:11:53.878523+0000","last_active":"2024-09-17T04:11:53.878523+0000","last_peered":"2024-09-17T04:11:53.878523+0000","last_clean":"2024-09-17T04:11:53.878523+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:53.878523+0000","last_undegraded":"2024-09-17T04:11:53.878523+0000","last_fullsized":"2024-09-17T04:11:53.878523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-17T04:11:53.878425+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-17T04:11:53.878425+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.878425+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:01.609091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.170624+0000","last_change":"2024-09-17T04:12:03.170624+0000","last_active":"2024-09-17T04:12:03.170624+0000","last_peered":"2024-09-17T04:12:03.170624+0000","last_clean":"2024-09-17T04:12:03.170624+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:12:03.170624+0000","last_undegraded":"2024-09-17T04:12:03.170624+0000","last_fullsized":"2024-09-17T04:12:03.170624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-09-17T04:12:03.170503+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-09-17T04:12:03.170503+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.170503+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:44.768280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.970677+0000","last_change":"2024-09-17T04:11:56.970599+0000","last_active":"2024-09-17T04:11:56.970677+0000","last_peered":"2024-09-17T04:11:56.970677+0000","last_clean":"2024-09-17T04:11:56.970677+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:56.970677+0000","last_undegraded":"2024-09-17T04:11:56.970677+0000","last_fullsized":"2024-09-17T04:11:56.970677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:56.970491+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:56.970491+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.970491+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:26.796879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.598219+0000","last_change":"2024-09-17T04:11:52.598157+0000","last_active":"2024-09-17T04:11:52.598219+0000","last_peered":"2024-09-17T04:11:52.598219+0000","last_clean":"2024-09-17T04:11:52.598219+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:52.598219+0000","last_undegraded":"2024-09-17T04:11:52.598219+0000","last_fullsized":"2024-09-17T04:11:52.598219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-17T04:11:52.598068+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-17T04:11:52.598068+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.598068+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:33.639187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'55","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.545181+0000","last_change":"2024-09-17T04:12:04.545181+0000","last_active":"2024-09-17T04:12:04.545181+0000","last_peered":"2024-09-17T04:12:04.545181+0000","last_clean":"2024-09-17T04:12:04.545181+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:12:04.545181+0000","last_undegraded":"2024-09-17T04:12:04.545181+0000","last_fullsized":"2024-09-17T04:12:04.545181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:04.545039+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:04.545039+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.545039+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:19.156448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.777065+0000","last_change":"2024-09-17T04:11:59.777065+0000","last_active":"2024-09-17T04:11:59.777065+0000","last_peered":"2024-09-17T04:11:59.777065+0000","last_clean":"2024-09-17T04:11:59.777065+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:59.777065+0000","last_undegraded":"2024-09-17T04:11:59.777065+0000","last_fullsized":"2024-09-17T04:11:59.777065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:11:59.776937+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:11:59.776937+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.776937+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:59.267334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.885415+0000","last_change":"2024-09-17T04:11:51.885360+0000","last_active":"2024-09-17T04:11:51.885415+0000","last_peered":"2024-09-17T04:11:51.885415+0000","last_clean":"2024-09-17T04:11:51.885415+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:51.885415+0000","last_undegraded":"2024-09-17T04:11:51.885415+0000","last_fullsized":"2024-09-17T04:11:51.885415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:51.885287+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:51.885287+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.885287+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:52.086151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'50","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.021996+0000","last_change":"2024-09-17T04:12:06.021996+0000","last_active":"2024-09-17T04:12:06.021996+0000","last_peered":"2024-09-17T04:12:06.021996+0000","last_clean":"2024-09-17T04:12:06.021996+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:12:06.021996+0000","last_undegraded":"2024-09-17T04:12:06.021996+0000","last_fullsized":"2024-09-17T04:12:06.021996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:06.021856+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:06.021856+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.021856+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:30.968818+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'39","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.748158+0000","last_change":"2024-09-17T04:12:01.748158+0000","last_active":"2024-09-17T04:12:01.748158+0000","last_peered":"2024-09-17T04:12:01.748158+0000","last_clean":"2024-09-17T04:12:01.748158+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:12:01.748158+0000","last_undegraded":"2024-09-17T04:12:01.748158+0000","last_fullsized":"2024-09-17T04:12:01.748158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-09-17T04:12:01.748059+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-09-17T04:12:01.748059+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.748059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.810827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.979572+0000","last_change":"2024-09-17T04:11:51.979495+0000","last_active":"2024-09-17T04:11:51.979572+0000","last_peered":"2024-09-17T04:11:51.979572+0000","last_clean":"2024-09-17T04:11:51.979572+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:51.979572+0000","last_undegraded":"2024-09-17T04:11:51.979572+0000","last_fullsized":"2024-09-17T04:11:51.979572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:51.979391+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:51.979391+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.979391+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.623637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'47","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.923822+0000","last_change":"2024-09-17T04:11:56.923822+0000","last_active":"2024-09-17T04:11:56.923822+0000","last_peered":"2024-09-17T04:11:56.923822+0000","last_clean":"2024-09-17T04:11:56.923822+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:56.923822+0000","last_undegraded":"2024-09-17T04:11:56.923822+0000","last_fullsized":"2024-09-17T04:11:56.923822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:11:56.923711+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:11:56.923711+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.923711+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:52.476314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'47","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.789148+0000","last_change":"2024-09-17T04:12:00.789059+0000","last_active":"2024-09-17T04:12:00.789148+0000","last_peered":"2024-09-17T04:12:00.789148+0000","last_clean":"2024-09-17T04:12:00.789148+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:12:00.789148+0000","last_undegraded":"2024-09-17T04:12:00.789148+0000","last_fullsized":"2024-09-17T04:12:00.789148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:12:00.788956+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:12:00.788956+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.788956+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:30.615344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'37","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.909958+0000","last_change":"2024-09-17T04:11:50.909884+0000","last_active":"2024-09-17T04:11:50.909958+0000","last_peered":"2024-09-17T04:11:50.909958+0000","last_clean":"2024-09-17T04:11:50.909958+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:50.909958+0000","last_undegraded":"2024-09-17T04:11:50.909958+0000","last_fullsized":"2024-09-17T04:11:50.909958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-17T04:11:50.909778+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-17T04:11:50.909778+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.909778+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:12.017485+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'54","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.622174+0000","last_change":"2024-09-17T04:12:02.622101+0000","last_active":"2024-09-17T04:12:02.622174+0000","last_peered":"2024-09-17T04:12:02.622174+0000","last_clean":"2024-09-17T04:12:02.622174+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:12:02.622174+0000","last_undegraded":"2024-09-17T04:12:02.622174+0000","last_fullsized":"2024-09-17T04:12:02.622174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:02.622010+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:02.622010+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.622010+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:30.361298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.187372+0000","last_change":"2024-09-17T04:11:56.187292+0000","last_active":"2024-09-17T04:11:56.187372+0000","last_peered":"2024-09-17T04:11:56.187372+0000","last_clean":"2024-09-17T04:11:56.187372+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:56.187372+0000","last_undegraded":"2024-09-17T04:11:56.187372+0000","last_fullsized":"2024-09-17T04:11:56.187372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:56.187192+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:56.187192+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.187192+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:23.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'30","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.220399+0000","last_change":"2024-09-17T04:11:55.220290+0000","last_active":"2024-09-17T04:11:55.220399+0000","last_peered":"2024-09-17T04:11:55.220399+0000","last_clean":"2024-09-17T04:11:55.220399+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:55.220399+0000","last_undegraded":"2024-09-17T04:11:55.220399+0000","last_fullsized":"2024-09-17T04:11:55.220399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-09-17T04:11:55.220167+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-09-17T04:11:55.220167+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.220167+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:40.370442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'43","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.266508+0000","last_change":"2024-09-17T04:12:07.266441+0000","last_active":"2024-09-17T04:12:07.266508+0000","last_peered":"2024-09-17T04:12:07.266508+0000","last_clean":"2024-09-17T04:12:07.266508+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:12:07.266508+0000","last_undegraded":"2024-09-17T04:12:07.266508+0000","last_fullsized":"2024-09-17T04:12:07.266508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:07.266364+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:07.266364+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.266364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:47.710044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'63","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.786435+0000","last_change":"2024-09-17T04:12:02.786329+0000","last_active":"2024-09-17T04:12:02.786435+0000","last_peered":"2024-09-17T04:12:02.786435+0000","last_clean":"2024-09-17T04:12:02.786435+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:12:02.786435+0000","last_undegraded":"2024-09-17T04:12:02.786435+0000","last_fullsized":"2024-09-17T04:12:02.786435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-09-17T04:12:02.786224+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-09-17T04:12:02.786224+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.786224+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:26.069743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'35","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.009676+0000","last_change":"2024-09-17T04:11:53.009616+0000","last_active":"2024-09-17T04:11:53.009676+0000","last_peered":"2024-09-17T04:11:53.009676+0000","last_clean":"2024-09-17T04:11:53.009676+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:53.009676+0000","last_undegraded":"2024-09-17T04:11:53.009676+0000","last_fullsized":"2024-09-17T04:11:53.009676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-09-17T04:11:53.009529+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-09-17T04:11:53.009529+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.009529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:14.928500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'34","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.252213+0000","last_change":"2024-09-17T04:12:06.252213+0000","last_active":"2024-09-17T04:12:06.252213+0000","last_peered":"2024-09-17T04:12:06.252213+0000","last_clean":"2024-09-17T04:12:06.252213+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:12:06.252213+0000","last_undegraded":"2024-09-17T04:12:06.252213+0000","last_fullsized":"2024-09-17T04:12:06.252213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-09-17T04:12:06.252145+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-09-17T04:12:06.252145+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.252145+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:59.811253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.686609+0000","last_change":"2024-09-17T04:11:50.686554+0000","last_active":"2024-09-17T04:11:50.686609+0000","last_peered":"2024-09-17T04:11:50.686609+0000","last_clean":"2024-09-17T04:11:50.686609+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:50.686609+0000","last_undegraded":"2024-09-17T04:11:50.686609+0000","last_fullsized":"2024-09-17T04:11:50.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:50.686485+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:50.686485+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.686485+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:35.836760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.766736+0000","last_change":"2024-09-17T04:11:53.766672+0000","last_active":"2024-09-17T04:11:53.766736+0000","last_peered":"2024-09-17T04:11:53.766736+0000","last_clean":"2024-09-17T04:11:53.766736+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:53.766736+0000","last_undegraded":"2024-09-17T04:11:53.766736+0000","last_fullsized":"2024-09-17T04:11:53.766736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-17T04:11:53.766590+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-17T04:11:53.766590+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.766590+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:03.810223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'38","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.039102+0000","last_change":"2024-09-17T04:12:07.039009+0000","last_active":"2024-09-17T04:12:07.039102+0000","last_peered":"2024-09-17T04:12:07.039102+0000","last_clean":"2024-09-17T04:12:07.039102+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:12:07.039102+0000","last_undegraded":"2024-09-17T04:12:07.039102+0000","last_fullsized":"2024-09-17T04:12:07.039102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-09-17T04:12:07.038889+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-09-17T04:12:07.038889+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.038889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.160150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.753789+0000","last_change":"2024-09-17T04:12:03.753714+0000","last_active":"2024-09-17T04:12:03.753789+0000","last_peered":"2024-09-17T04:12:03.753789+0000","last_clean":"2024-09-17T04:12:03.753789+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:12:03.753789+0000","last_undegraded":"2024-09-17T04:12:03.753789+0000","last_fullsized":"2024-09-17T04:12:03.753789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:03.753609+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:03.753609+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.753609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:37.104636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1193","reported_seq":1229,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.217566+0000","last_change":"2024-09-17T04:11:51.217499+0000","last_active":"2024-09-17T04:11:51.217566+0000","last_peered":"2024-09-17T04:11:51.217566+0000","last_clean":"2024-09-17T04:11:51.217566+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:51.217566+0000","last_undegraded":"2024-09-17T04:11:51.217566+0000","last_fullsized":"2024-09-17T04:11:51.217566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1193","last_scrub_stamp":"2024-09-17T04:11:51.217378+0000","last_deep_scrub":"29'1193","last_deep_scrub_stamp":"2024-09-17T04:11:51.217378+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.217378+0000","objects_scrubbed":4,"log_size":1193,"log_dups_size":0,"ondisk_log_size":1193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.400098+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":5144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.545937+0000","last_change":"2024-09-17T04:12:04.545851+0000","last_active":"2024-09-17T04:12:04.545937+0000","last_peered":"2024-09-17T04:12:04.545937+0000","last_clean":"2024-09-17T04:12:04.545937+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:12:04.545937+0000","last_undegraded":"2024-09-17T04:12:04.545937+0000","last_fullsized":"2024-09-17T04:12:04.545937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:04.545747+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:04.545747+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.545747+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:44.903938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.006269+0000","last_change":"2024-09-17T04:11:54.006154+0000","last_active":"2024-09-17T04:11:54.006269+0000","last_peered":"2024-09-17T04:11:54.006269+0000","last_clean":"2024-09-17T04:11:54.006269+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:54.006269+0000","last_undegraded":"2024-09-17T04:11:54.006269+0000","last_fullsized":"2024-09-17T04:11:54.006269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:54.006009+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:54.006009+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.006009+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:07.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'42","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.635392+0000","last_change":"2024-09-17T04:11:53.635319+0000","last_active":"2024-09-17T04:11:53.635392+0000","last_peered":"2024-09-17T04:11:53.635392+0000","last_clean":"2024-09-17T04:11:53.635392+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:53.635392+0000","last_undegraded":"2024-09-17T04:11:53.635392+0000","last_fullsized":"2024-09-17T04:11:53.635392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:53.635226+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:53.635226+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.635226+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:19.590957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'45","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.873520+0000","last_change":"2024-09-17T04:12:02.873447+0000","last_active":"2024-09-17T04:12:02.873520+0000","last_peered":"2024-09-17T04:12:02.873520+0000","last_clean":"2024-09-17T04:12:02.873520+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:12:02.873520+0000","last_undegraded":"2024-09-17T04:12:02.873520+0000","last_fullsized":"2024-09-17T04:12:02.873520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:12:02.873360+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:12:02.873360+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.873360+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:54.832082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'50","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.727227+0000","last_change":"2024-09-17T04:11:52.727108+0000","last_active":"2024-09-17T04:11:52.727227+0000","last_peered":"2024-09-17T04:11:52.727227+0000","last_clean":"2024-09-17T04:11:52.727227+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:52.727227+0000","last_undegraded":"2024-09-17T04:11:52.727227+0000","last_fullsized":"2024-09-17T04:11:52.727227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:52.726948+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:52.726948+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.726948+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:08.423760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.968756+0000","last_change":"2024-09-17T04:11:54.968651+0000","last_active":"2024-09-17T04:11:54.968756+0000","last_peered":"2024-09-17T04:11:54.968756+0000","last_clean":"2024-09-17T04:11:54.968756+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:54.968756+0000","last_undegraded":"2024-09-17T04:11:54.968756+0000","last_fullsized":"2024-09-17T04:11:54.968756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:54.968549+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:54.968549+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.968549+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:43.723762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'39","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.261367+0000","last_change":"2024-09-17T04:12:03.261280+0000","last_active":"2024-09-17T04:12:03.261367+0000","last_peered":"2024-09-17T04:12:03.261367+0000","last_clean":"2024-09-17T04:12:03.261367+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:12:03.261367+0000","last_undegraded":"2024-09-17T04:12:03.261367+0000","last_fullsized":"2024-09-17T04:12:03.261367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-09-17T04:12:03.261186+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-09-17T04:12:03.261186+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.261186+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:30.613630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'73","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.926015+0000","last_change":"2024-09-17T04:11:55.925949+0000","last_active":"2024-09-17T04:11:55.926015+0000","last_peered":"2024-09-17T04:11:55.926015+0000","last_clean":"2024-09-17T04:11:55.926015+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:55.926015+0000","last_undegraded":"2024-09-17T04:11:55.926015+0000","last_fullsized":"2024-09-17T04:11:55.926015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-09-17T04:11:55.925860+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-09-17T04:11:55.925860+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.925860+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:55.416256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'23","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.252779+0000","last_change":"2024-09-17T04:11:52.252660+0000","last_active":"2024-09-17T04:11:52.252779+0000","last_peered":"2024-09-17T04:11:52.252779+0000","last_clean":"2024-09-17T04:11:52.252779+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:52.252779+0000","last_undegraded":"2024-09-17T04:11:52.252779+0000","last_fullsized":"2024-09-17T04:11:52.252779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-17T04:11:52.252562+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-17T04:11:52.252562+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.252562+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:51.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'42","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.239058+0000","last_change":"2024-09-17T04:12:05.239058+0000","last_active":"2024-09-17T04:12:05.239058+0000","last_peered":"2024-09-17T04:12:05.239058+0000","last_clean":"2024-09-17T04:12:05.239058+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:12:05.239058+0000","last_undegraded":"2024-09-17T04:12:05.239058+0000","last_fullsized":"2024-09-17T04:12:05.239058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:12:05.238911+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:12:05.238911+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.238911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:06.839317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.594147+0000","last_change":"2024-09-17T04:12:03.594147+0000","last_active":"2024-09-17T04:12:03.594147+0000","last_peered":"2024-09-17T04:12:03.594147+0000","last_clean":"2024-09-17T04:12:03.594147+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:12:03.594147+0000","last_undegraded":"2024-09-17T04:12:03.594147+0000","last_fullsized":"2024-09-17T04:12:03.594147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:03.594053+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:03.594053+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.594053+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:54.774282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'54","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.546667+0000","last_change":"2024-09-17T04:12:01.546581+0000","last_active":"2024-09-17T04:12:01.546667+0000","last_peered":"2024-09-17T04:12:01.546667+0000","last_clean":"2024-09-17T04:12:01.546667+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:12:01.546667+0000","last_undegraded":"2024-09-17T04:12:01.546667+0000","last_fullsized":"2024-09-17T04:12:01.546667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:01.546499+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:01.546499+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.546499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:17.535930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.976553+0000","last_change":"2024-09-17T04:11:53.976442+0000","last_active":"2024-09-17T04:11:53.976553+0000","last_peered":"2024-09-17T04:11:53.976553+0000","last_clean":"2024-09-17T04:11:53.976553+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:53.976553+0000","last_undegraded":"2024-09-17T04:11:53.976553+0000","last_fullsized":"2024-09-17T04:11:53.976553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-17T04:11:53.976342+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-17T04:11:53.976342+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.976342+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:14.339361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'50","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.206877+0000","last_change":"2024-09-17T04:12:04.206877+0000","last_active":"2024-09-17T04:12:04.206877+0000","last_peered":"2024-09-17T04:12:04.206877+0000","last_clean":"2024-09-17T04:12:04.206877+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:12:04.206877+0000","last_undegraded":"2024-09-17T04:12:04.206877+0000","last_fullsized":"2024-09-17T04:12:04.206877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:04.206766+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:04.206766+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.206766+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:56.215874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'65","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.169728+0000","last_change":"2024-09-17T04:11:56.169643+0000","last_active":"2024-09-17T04:11:56.169728+0000","last_peered":"2024-09-17T04:11:56.169728+0000","last_clean":"2024-09-17T04:11:56.169728+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:56.169728+0000","last_undegraded":"2024-09-17T04:11:56.169728+0000","last_fullsized":"2024-09-17T04:11:56.169728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-17T04:11:56.169545+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-17T04:11:56.169545+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.169545+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.058175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.188632+0000","last_change":"2024-09-17T04:11:51.188540+0000","last_active":"2024-09-17T04:11:51.188632+0000","last_peered":"2024-09-17T04:11:51.188632+0000","last_clean":"2024-09-17T04:11:51.188632+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:51.188632+0000","last_undegraded":"2024-09-17T04:11:51.188632+0000","last_fullsized":"2024-09-17T04:11:51.188632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-17T04:11:51.188421+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-17T04:11:51.188421+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.188421+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:09.687105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.266113+0000","last_change":"2024-09-17T04:11:53.266042+0000","last_active":"2024-09-17T04:11:53.266113+0000","last_peered":"2024-09-17T04:11:53.266113+0000","last_clean":"2024-09-17T04:11:53.266113+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:53.266113+0000","last_undegraded":"2024-09-17T04:11:53.266113+0000","last_fullsized":"2024-09-17T04:11:53.266113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-17T04:11:53.265923+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-17T04:11:53.265923+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.265923+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:03.333430+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'51","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.673754+0000","last_change":"2024-09-17T04:11:59.673754+0000","last_active":"2024-09-17T04:11:59.673754+0000","last_peered":"2024-09-17T04:11:59.673754+0000","last_clean":"2024-09-17T04:11:59.673754+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:59.673754+0000","last_undegraded":"2024-09-17T04:11:59.673754+0000","last_fullsized":"2024-09-17T04:11:59.673754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:59.673671+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:59.673671+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.673671+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:03.918950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'36","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.840889+0000","last_change":"2024-09-17T04:11:57.840889+0000","last_active":"2024-09-17T04:11:57.840889+0000","last_peered":"2024-09-17T04:11:57.840889+0000","last_clean":"2024-09-17T04:11:57.840889+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:57.840889+0000","last_undegraded":"2024-09-17T04:11:57.840889+0000","last_fullsized":"2024-09-17T04:11:57.840889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-09-17T04:11:57.840789+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-09-17T04:11:57.840789+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.840789+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.859542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1536,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.196735+0000","last_change":"2024-09-17T04:11:53.196614+0000","last_active":"2024-09-17T04:11:53.196735+0000","last_peered":"2024-09-17T04:11:53.196735+0000","last_clean":"2024-09-17T04:11:53.196735+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:53.196735+0000","last_undegraded":"2024-09-17T04:11:53.196735+0000","last_fullsized":"2024-09-17T04:11:53.196735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1500","last_scrub_stamp":"2024-09-17T04:11:53.196512+0000","last_deep_scrub":"29'1500","last_deep_scrub_stamp":"2024-09-17T04:11:53.196512+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.196512+0000","objects_scrubbed":1,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:49.272799+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'44","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.010341+0000","last_change":"2024-09-17T04:11:53.010341+0000","last_active":"2024-09-17T04:11:53.010341+0000","last_peered":"2024-09-17T04:11:53.010341+0000","last_clean":"2024-09-17T04:11:53.010341+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:53.010341+0000","last_undegraded":"2024-09-17T04:11:53.010341+0000","last_fullsized":"2024-09-17T04:11:53.010341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:11:53.010235+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:11:53.010235+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.010235+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:46.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:40.742674+0000","last_change":"2024-09-17T04:09:44.388149+0000","last_active":"2024-09-17T04:11:40.742674+0000","last_peered":"2024-09-17T04:11:40.742674+0000","last_clean":"2024-09-17T04:11:40.742674+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:11:40.742674+0000","last_undegraded":"2024-09-17T04:11:40.742674+0000","last_fullsized":"2024-09-17T04:11:40.742674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:43.356388+0000","last_clean_scrub_stamp":"2024-09-17T04:09:43.356388+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:18.031444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'69","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.145925+0000","last_change":"2024-09-17T04:11:58.145925+0000","last_active":"2024-09-17T04:11:58.145925+0000","last_peered":"2024-09-17T04:11:58.145925+0000","last_clean":"2024-09-17T04:11:58.145925+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:58.145925+0000","last_undegraded":"2024-09-17T04:11:58.145925+0000","last_fullsized":"2024-09-17T04:11:58.145925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'69","last_scrub_stamp":"2024-09-17T04:11:58.145837+0000","last_deep_scrub":"29'69","last_deep_scrub_stamp":"2024-09-17T04:11:58.145837+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.145837+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:01.980709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'59","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.855734+0000","last_change":"2024-09-17T04:11:49.855734+0000","last_active":"2024-09-17T04:11:49.855734+0000","last_peered":"2024-09-17T04:11:49.855734+0000","last_clean":"2024-09-17T04:11:49.855734+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:49.855734+0000","last_undegraded":"2024-09-17T04:11:49.855734+0000","last_fullsized":"2024-09-17T04:11:49.855734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2024-09-17T04:11:49.855663+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2024-09-17T04:11:49.855663+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.855663+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.938829+0000","last_change":"2024-09-17T04:12:00.938829+0000","last_active":"2024-09-17T04:12:00.938829+0000","last_peered":"2024-09-17T04:12:00.938829+0000","last_clean":"2024-09-17T04:12:00.938829+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:12:00.938829+0000","last_undegraded":"2024-09-17T04:12:00.938829+0000","last_fullsized":"2024-09-17T04:12:00.938829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:12:00.938719+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:12:00.938719+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.938719+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:28.574921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'52","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.696830+0000","last_change":"2024-09-17T04:11:57.696830+0000","last_active":"2024-09-17T04:11:57.696830+0000","last_peered":"2024-09-17T04:11:57.696830+0000","last_clean":"2024-09-17T04:11:57.696830+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:57.696830+0000","last_undegraded":"2024-09-17T04:11:57.696830+0000","last_fullsized":"2024-09-17T04:11:57.696830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-09-17T04:11:57.696736+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-09-17T04:11:57.696736+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.696736+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:27.523124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'50","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.266358+0000","last_change":"2024-09-17T04:11:58.266358+0000","last_active":"2024-09-17T04:11:58.266358+0000","last_peered":"2024-09-17T04:11:58.266358+0000","last_clean":"2024-09-17T04:11:58.266358+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:58.266358+0000","last_undegraded":"2024-09-17T04:11:58.266358+0000","last_fullsized":"2024-09-17T04:11:58.266358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:58.266238+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:58.266238+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.266238+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:12.258250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'37","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.642547+0000","last_change":"2024-09-17T04:11:56.642547+0000","last_active":"2024-09-17T04:11:56.642547+0000","last_peered":"2024-09-17T04:11:56.642547+0000","last_clean":"2024-09-17T04:11:56.642547+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:56.642547+0000","last_undegraded":"2024-09-17T04:11:56.642547+0000","last_fullsized":"2024-09-17T04:11:56.642547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-17T04:11:56.642459+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-17T04:11:56.642459+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.642459+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:30.552630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'66","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.127830+0000","last_change":"2024-09-17T04:11:59.127830+0000","last_active":"2024-09-17T04:11:59.127830+0000","last_peered":"2024-09-17T04:11:59.127830+0000","last_clean":"2024-09-17T04:11:59.127830+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:59.127830+0000","last_undegraded":"2024-09-17T04:11:59.127830+0000","last_fullsized":"2024-09-17T04:11:59.127830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-09-17T04:11:59.127734+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-09-17T04:11:59.127734+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.127734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:21.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'42","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.236816+0000","last_change":"2024-09-17T04:11:59.236816+0000","last_active":"2024-09-17T04:11:59.236816+0000","last_peered":"2024-09-17T04:11:59.236816+0000","last_clean":"2024-09-17T04:11:59.236816+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:59.236816+0000","last_undegraded":"2024-09-17T04:11:59.236816+0000","last_fullsized":"2024-09-17T04:11:59.236816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:59.236720+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:59.236720+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.236720+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:44.523201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.950597+0000","last_change":"2024-09-17T04:11:59.950597+0000","last_active":"2024-09-17T04:11:59.950597+0000","last_peered":"2024-09-17T04:11:59.950597+0000","last_clean":"2024-09-17T04:11:59.950597+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:59.950597+0000","last_undegraded":"2024-09-17T04:11:59.950597+0000","last_fullsized":"2024-09-17T04:11:59.950597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:59.950487+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:59.950487+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.950487+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:14.213032+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.272997+0000","last_change":"2024-09-17T04:12:01.272997+0000","last_active":"2024-09-17T04:12:01.272997+0000","last_peered":"2024-09-17T04:12:01.272997+0000","last_clean":"2024-09-17T04:12:01.272997+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:12:01.272997+0000","last_undegraded":"2024-09-17T04:12:01.272997+0000","last_fullsized":"2024-09-17T04:12:01.272997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:01.272882+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:01.272882+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.272882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:22.712837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.985702+0000","last_change":"2024-09-17T04:12:02.985702+0000","last_active":"2024-09-17T04:12:02.985702+0000","last_peered":"2024-09-17T04:12:02.985702+0000","last_clean":"2024-09-17T04:12:02.985702+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:12:02.985702+0000","last_undegraded":"2024-09-17T04:12:02.985702+0000","last_fullsized":"2024-09-17T04:12:02.985702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:12:02.985581+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:12:02.985581+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.985581+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:46.220816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'63","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.625030+0000","last_change":"2024-09-17T04:12:00.625030+0000","last_active":"2024-09-17T04:12:00.625030+0000","last_peered":"2024-09-17T04:12:00.625030+0000","last_clean":"2024-09-17T04:12:00.625030+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:12:00.625030+0000","last_undegraded":"2024-09-17T04:12:00.625030+0000","last_fullsized":"2024-09-17T04:12:00.625030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-09-17T04:12:00.624912+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-09-17T04:12:00.624912+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.624912+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:52.060207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'62","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.134271+0000","last_change":"2024-09-17T04:12:00.134271+0000","last_active":"2024-09-17T04:12:00.134271+0000","last_peered":"2024-09-17T04:12:00.134271+0000","last_clean":"2024-09-17T04:12:00.134271+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:12:00.134271+0000","last_undegraded":"2024-09-17T04:12:00.134271+0000","last_fullsized":"2024-09-17T04:12:00.134271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'62","last_scrub_stamp":"2024-09-17T04:12:00.134127+0000","last_deep_scrub":"29'62","last_deep_scrub_stamp":"2024-09-17T04:12:00.134127+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.134127+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:20.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.718337+0000","last_change":"2024-09-17T04:12:04.718337+0000","last_active":"2024-09-17T04:12:04.718337+0000","last_peered":"2024-09-17T04:12:04.718337+0000","last_clean":"2024-09-17T04:12:04.718337+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:12:04.718337+0000","last_undegraded":"2024-09-17T04:12:04.718337+0000","last_fullsized":"2024-09-17T04:12:04.718337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:04.718244+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:04.718244+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.718244+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:10.748177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.885280+0000","last_change":"2024-09-17T04:11:55.885209+0000","last_active":"2024-09-17T04:11:55.885280+0000","last_peered":"2024-09-17T04:11:55.885280+0000","last_clean":"2024-09-17T04:11:55.885280+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:55.885280+0000","last_undegraded":"2024-09-17T04:11:55.885280+0000","last_fullsized":"2024-09-17T04:11:55.885280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:55.885119+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:55.885119+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.885119+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:02.262847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.847135+0000","last_change":"2024-09-17T04:11:56.847135+0000","last_active":"2024-09-17T04:11:56.847135+0000","last_peered":"2024-09-17T04:11:56.847135+0000","last_clean":"2024-09-17T04:11:56.847135+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:56.847135+0000","last_undegraded":"2024-09-17T04:11:56.847135+0000","last_fullsized":"2024-09-17T04:11:56.847135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:56.847047+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:56.847047+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.847047+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:49.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.956619+0000","last_change":"2024-09-17T04:12:01.956548+0000","last_active":"2024-09-17T04:12:01.956619+0000","last_peered":"2024-09-17T04:12:01.956619+0000","last_clean":"2024-09-17T04:12:01.956619+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:12:01.956619+0000","last_undegraded":"2024-09-17T04:12:01.956619+0000","last_fullsized":"2024-09-17T04:12:01.956619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:01.956464+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:01.956464+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.956464+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:29.695752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'53","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.604842+0000","last_change":"2024-09-17T04:11:57.604746+0000","last_active":"2024-09-17T04:11:57.604842+0000","last_peered":"2024-09-17T04:11:57.604842+0000","last_clean":"2024-09-17T04:11:57.604842+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:57.604842+0000","last_undegraded":"2024-09-17T04:11:57.604842+0000","last_fullsized":"2024-09-17T04:11:57.604842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2024-09-17T04:11:57.604603+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2024-09-17T04:11:57.604603+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.604603+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:40.352951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'59","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.704555+0000","last_change":"2024-09-17T04:11:56.704494+0000","last_active":"2024-09-17T04:11:56.704555+0000","last_peered":"2024-09-17T04:11:56.704555+0000","last_clean":"2024-09-17T04:11:56.704555+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:56.704555+0000","last_undegraded":"2024-09-17T04:11:56.704555+0000","last_fullsized":"2024-09-17T04:11:56.704555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2024-09-17T04:11:56.704401+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2024-09-17T04:11:56.704401+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.704401+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.194797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.267172+0000","last_change":"2024-09-17T04:12:00.267100+0000","last_active":"2024-09-17T04:12:00.267172+0000","last_peered":"2024-09-17T04:12:00.267172+0000","last_clean":"2024-09-17T04:12:00.267172+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:12:00.267172+0000","last_undegraded":"2024-09-17T04:12:00.267172+0000","last_fullsized":"2024-09-17T04:12:00.267172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:12:00.267014+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:12:00.267014+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.267014+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:11.160179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'44","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.968902+0000","last_change":"2024-09-17T04:11:54.968792+0000","last_active":"2024-09-17T04:11:54.968902+0000","last_peered":"2024-09-17T04:11:54.968902+0000","last_clean":"2024-09-17T04:11:54.968902+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:54.968902+0000","last_undegraded":"2024-09-17T04:11:54.968902+0000","last_fullsized":"2024-09-17T04:11:54.968902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:11:54.968643+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:11:54.968643+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.968643+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:25.018394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'50","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.148577+0000","last_change":"2024-09-17T04:12:01.148510+0000","last_active":"2024-09-17T04:12:01.148577+0000","last_peered":"2024-09-17T04:12:01.148577+0000","last_clean":"2024-09-17T04:12:01.148577+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:12:01.148577+0000","last_undegraded":"2024-09-17T04:12:01.148577+0000","last_fullsized":"2024-09-17T04:12:01.148577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:01.148412+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:01.148412+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.148412+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:49.903624+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'53","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.152318+0000","last_change":"2024-09-17T04:12:02.152251+0000","last_active":"2024-09-17T04:12:02.152318+0000","last_peered":"2024-09-17T04:12:02.152318+0000","last_clean":"2024-09-17T04:12:02.152318+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:12:02.152318+0000","last_undegraded":"2024-09-17T04:12:02.152318+0000","last_fullsized":"2024-09-17T04:12:02.152318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2024-09-17T04:12:02.152143+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2024-09-17T04:12:02.152143+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.152143+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:01.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'54","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.717134+0000","last_change":"2024-09-17T04:12:05.717061+0000","last_active":"2024-09-17T04:12:05.717134+0000","last_peered":"2024-09-17T04:12:05.717134+0000","last_clean":"2024-09-17T04:12:05.717134+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:12:05.717134+0000","last_undegraded":"2024-09-17T04:12:05.717134+0000","last_fullsized":"2024-09-17T04:12:05.717134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:05.716954+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:05.716954+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.716954+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:52.921183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'51","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.242173+0000","last_change":"2024-09-17T04:12:02.242173+0000","last_active":"2024-09-17T04:12:02.242173+0000","last_peered":"2024-09-17T04:12:02.242173+0000","last_clean":"2024-09-17T04:12:02.242173+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:12:02.242173+0000","last_undegraded":"2024-09-17T04:12:02.242173+0000","last_fullsized":"2024-09-17T04:12:02.242173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:02.242039+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:02.242039+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.242039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:06.456955+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'54","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.695261+0000","last_change":"2024-09-17T04:12:06.695261+0000","last_active":"2024-09-17T04:12:06.695261+0000","last_peered":"2024-09-17T04:12:06.695261+0000","last_clean":"2024-09-17T04:12:06.695261+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:12:06.695261+0000","last_undegraded":"2024-09-17T04:12:06.695261+0000","last_fullsized":"2024-09-17T04:12:06.695261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:06.695151+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:06.695151+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.695151+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:49.930386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'51","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.987457+0000","last_change":"2024-09-17T04:12:03.987457+0000","last_active":"2024-09-17T04:12:03.987457+0000","last_peered":"2024-09-17T04:12:03.987457+0000","last_clean":"2024-09-17T04:12:03.987457+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:12:03.987457+0000","last_undegraded":"2024-09-17T04:12:03.987457+0000","last_fullsized":"2024-09-17T04:12:03.987457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:03.987348+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:03.987348+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.987348+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:03.180468+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'55","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:42.726135+0000","last_change":"2024-09-17T04:09:40.359270+0000","last_active":"2024-09-17T04:11:42.726135+0000","last_peered":"2024-09-17T04:11:42.726135+0000","last_clean":"2024-09-17T04:11:42.726135+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:11:42.726135+0000","last_undegraded":"2024-09-17T04:11:42.726135+0000","last_fullsized":"2024-09-17T04:11:42.726135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:09:39.316127+0000","last_clean_scrub_stamp":"2024-09-17T04:09:39.316127+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:12.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'40","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.983661+0000","last_change":"2024-09-17T04:12:04.983661+0000","last_active":"2024-09-17T04:12:04.983661+0000","last_peered":"2024-09-17T04:12:04.983661+0000","last_clean":"2024-09-17T04:12:04.983661+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:12:04.983661+0000","last_undegraded":"2024-09-17T04:12:04.983661+0000","last_fullsized":"2024-09-17T04:12:04.983661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:04.983566+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:04.983566+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.983566+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:08.011578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.734916+0000","last_change":"2024-09-17T04:11:54.734916+0000","last_active":"2024-09-17T04:11:54.734916+0000","last_peered":"2024-09-17T04:11:54.734916+0000","last_clean":"2024-09-17T04:11:54.734916+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:54.734916+0000","last_undegraded":"2024-09-17T04:11:54.734916+0000","last_fullsized":"2024-09-17T04:11:54.734916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:54.734823+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:54.734823+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.734823+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:47.686457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.595321+0000","last_change":"2024-09-17T04:11:59.595321+0000","last_active":"2024-09-17T04:11:59.595321+0000","last_peered":"2024-09-17T04:11:59.595321+0000","last_clean":"2024-09-17T04:11:59.595321+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:59.595321+0000","last_undegraded":"2024-09-17T04:11:59.595321+0000","last_fullsized":"2024-09-17T04:11:59.595321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:59.595223+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:59.595223+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.595223+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:24.999352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.721941+0000","last_change":"2024-09-17T04:12:07.721941+0000","last_active":"2024-09-17T04:12:07.721941+0000","last_peered":"2024-09-17T04:12:07.721941+0000","last_clean":"2024-09-17T04:12:07.721941+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:12:07.721941+0000","last_undegraded":"2024-09-17T04:12:07.721941+0000","last_fullsized":"2024-09-17T04:12:07.721941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:12:07.721844+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:12:07.721844+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.721844+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:06.914965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30916026,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":3055,"num_write_kb":32947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61890560,"data_stored":61832052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57932,"kb_used_data":18428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313908,"statfs":{"total":96636764160,"available":96577441792,"internally_reserved":0,"allocated":18870272,"data_stored":18679561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49100,"kb_used_data":13756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322740,"statfs":{"total":96636764160,"available":96586485760,"internally_reserved":0,"allocated":14086144,"data_stored":13894979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509476,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74668,"kb_used_data":12956,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94297172,"statfs":{"total":96636764160,"available":96560304128,"internally_reserved":0,"allocated":13266944,"data_stored":13077537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":493953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40268,"kb_used_data":9084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331572,"statfs":{"total":96636764160,"available":96595529728,"internally_reserved":0,"allocated":9302016,"data_stored":9105074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13778944,"data_stored":13769519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17969152,"data_stored":17963733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:12:11.781 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T04:09:43.356388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:12:11.781 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-17T04:09:39.316127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=9, tm_sec=39, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=11, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:12:11.781 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T04:12:31.783 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 -- 172.21.15.104:0/3716240572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b40d19f0 msgr2=0x7ff2b415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 --2- 172.21.15.104:0/3716240572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b40d19f0 0x7ff2b415cf20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009830 tx=0x7ff2a802a5c0 comp rx=0 tx=0).stop 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 -- 172.21.15.104:0/3716240572 shutdown_connections 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 --2- 172.21.15.104:0/3716240572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b40d19f0 0x7ff2b415cf20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 -- 172.21.15.104:0/3716240572 >> 172.21.15.104:0/3716240572 conn(0x7ff2b40d2350 msgr2=0x7ff2b40d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 -- 172.21.15.104:0/3716240572 shutdown_connections 2024-09-17T04:12:31.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.912+0000 7ff2b8884640 1 -- 172.21.15.104:0/3716240572 wait complete. 2024-09-17T04:12:31.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.914+0000 7ff2b8884640 1 Processor -- start 2024-09-17T04:12:31.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.914+0000 7ff2b8884640 1 -- start start 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2b40b6250 0x7ff2b415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2b40d19f0 0x7ff2b414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b40b7100 con 0x7ff2b415cb10 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b40b6f80 con 0x7ff2b40d19f0 2024-09-17T04:12:31.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b8884640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b40b7280 con 0x7ff2b40b6250 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41444/0 (socket says 172.21.15.104:41444) 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b2d9d640 1 -- 172.21.15.104:0/1440165725 learned_addr learned my addr 172.21.15.104:0/1440165725 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b1d9b640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2b40d19f0 0x7ff2b414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.915+0000 7ff2b259c640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2b40b6250 0x7ff2b415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 -- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2b40b6250 msgr2=0x7ff2b415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2b40b6250 0x7ff2b415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 -- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2b40d19f0 msgr2=0x7ff2b414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2b40d19f0 0x7ff2b414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 -- 172.21.15.104:0/1440165725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b415be20 con 0x7ff2b415cb10 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b2d9d640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c760 tx=0x7ff2ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac003da0 con 0x7ff2b415cb10 2024-09-17T04:12:31.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2ac00ce10 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b415c330 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0052d0 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.916+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b414d820 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.917+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b415cf20 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.918+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2ac005470 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.918+0000 7ff2a2ffd640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 0x7ff29407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.918+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7ff2ac09ae30 con 0x7ff2b415cb10 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.918+0000 7ff2b259c640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 0x7ff29407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:31.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.919+0000 7ff2b259c640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 0x7ff29407b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4000f60 tx=0x7ff2a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:31.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:31.923+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2ac0627a0 con 0x7ff2b415cb10 2024-09-17T04:12:32.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.095+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 --> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2b4153580 con 0x7ff294078bc0 2024-09-17T04:12:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.101+0000 7ff2a2ffd640 1 -- 172.21.15.104:0/1440165725 <== mgr.4100 v2:172.21.15.192:6800/330081550 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333782 (secure 0 0 0) 0x7ff2b4153580 con 0x7ff294078bc0 2024-09-17T04:12:32.104 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:12:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.104+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 msgr2=0x7ff29407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.104+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 0x7ff29407b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4000f60 tx=0x7ff2a4009040 comp rx=0 tx=0).stop 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.104+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 msgr2=0x7ff2b4148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.104+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c760 tx=0x7ff2ac00cc20 comp rx=0 tx=0).stop 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 shutdown_connections 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7ff294078bc0 0x7ff29407b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2b40d19f0 0x7ff2b414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b415cb10 0x7ff2b4148520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 --2- 172.21.15.104:0/1440165725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2b40b6250 0x7ff2b415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 >> 172.21.15.104:0/1440165725 conn(0x7ff2b40d2350 msgr2=0x7ff2b40cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 shutdown_connections 2024-09-17T04:12:32.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.105+0000 7ff2b8884640 1 -- 172.21.15.104:0/1440165725 wait complete. 2024-09-17T04:12:32.116 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-17T04:12:31.390369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31506394,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":93,"num_read_kb":434,"num_write":3156,"num_write_kb":34575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8556,"ondisk_log_size":8556,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356480,"kb_used_data":64000,"kb_used_omap":12,"kb_used_meta":292339,"kb_avail":754618240,"statfs":{"total":773094113280,"available":772729077760,"internally_reserved":0,"allocated":65536000,"data_stored":64016468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":299355696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003916"},"pg_stats":[{"pgid":"2.1f","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.712818+0000","last_change":"2024-09-17T04:11:51.712818+0000","last_active":"2024-09-17T04:11:51.712818+0000","last_peered":"2024-09-17T04:11:51.712818+0000","last_clean":"2024-09-17T04:11:51.712818+0000","last_became_active":"2024-09-17T04:09:39.339230+0000","last_became_peered":"2024-09-17T04:09:39.339230+0000","last_unstale":"2024-09-17T04:11:51.712818+0000","last_undegraded":"2024-09-17T04:11:51.712818+0000","last_fullsized":"2024-09-17T04:11:51.712818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.712746+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.712746+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.712746+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:19.119908+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'46","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.219551+0000","last_change":"2024-09-17T04:11:57.219551+0000","last_active":"2024-09-17T04:11:57.219551+0000","last_peered":"2024-09-17T04:11:57.219551+0000","last_clean":"2024-09-17T04:11:57.219551+0000","last_became_active":"2024-09-17T04:09:40.355842+0000","last_became_peered":"2024-09-17T04:09:40.355842+0000","last_unstale":"2024-09-17T04:11:57.219551+0000","last_undegraded":"2024-09-17T04:11:57.219551+0000","last_fullsized":"2024-09-17T04:11:57.219551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:57.219450+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:57.219450+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.219450+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:46.727616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'49","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:08.300711+0000","last_change":"2024-09-17T04:12:08.300636+0000","last_active":"2024-09-17T04:12:08.300711+0000","last_peered":"2024-09-17T04:12:08.300711+0000","last_clean":"2024-09-17T04:12:08.300711+0000","last_became_active":"2024-09-17T04:09:44.495116+0000","last_became_peered":"2024-09-17T04:09:44.495116+0000","last_unstale":"2024-09-17T04:12:08.300711+0000","last_undegraded":"2024-09-17T04:12:08.300711+0000","last_fullsized":"2024-09-17T04:12:08.300711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:12:08.300517+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:12:08.300517+0000","last_clean_scrub_stamp":"2024-09-17T04:12:08.300517+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:42.213619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'32","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.237280+0000","last_change":"2024-09-17T04:11:50.237280+0000","last_active":"2024-09-17T04:11:50.237280+0000","last_peered":"2024-09-17T04:11:50.237280+0000","last_clean":"2024-09-17T04:11:50.237280+0000","last_became_active":"2024-09-17T04:09:39.338220+0000","last_became_peered":"2024-09-17T04:09:39.338220+0000","last_unstale":"2024-09-17T04:11:50.237280+0000","last_undegraded":"2024-09-17T04:11:50.237280+0000","last_fullsized":"2024-09-17T04:11:50.237280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2024-09-17T04:11:50.237181+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2024-09-17T04:11:50.237181+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.237181+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:42.136321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'57","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.718816+0000","last_change":"2024-09-17T04:11:55.718816+0000","last_active":"2024-09-17T04:11:55.718816+0000","last_peered":"2024-09-17T04:11:55.718816+0000","last_clean":"2024-09-17T04:11:55.718816+0000","last_became_active":"2024-09-17T04:09:40.339889+0000","last_became_peered":"2024-09-17T04:09:40.339889+0000","last_unstale":"2024-09-17T04:11:55.718816+0000","last_undegraded":"2024-09-17T04:11:55.718816+0000","last_fullsized":"2024-09-17T04:11:55.718816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-09-17T04:11:55.718718+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-09-17T04:11:55.718718+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.718718+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:44.473931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.909627+0000","last_change":"2024-09-17T04:12:00.909551+0000","last_active":"2024-09-17T04:12:00.909627+0000","last_peered":"2024-09-17T04:12:00.909627+0000","last_clean":"2024-09-17T04:12:00.909627+0000","last_became_active":"2024-09-17T04:09:44.387706+0000","last_became_peered":"2024-09-17T04:09:44.387706+0000","last_unstale":"2024-09-17T04:12:00.909627+0000","last_undegraded":"2024-09-17T04:12:00.909627+0000","last_fullsized":"2024-09-17T04:12:00.909627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:00.909456+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:00.909456+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.909456+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:19.408140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'61","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.725595+0000","last_change":"2024-09-17T04:11:56.725489+0000","last_active":"2024-09-17T04:11:56.725595+0000","last_peered":"2024-09-17T04:11:56.725595+0000","last_clean":"2024-09-17T04:11:56.725595+0000","last_became_active":"2024-09-17T04:09:39.344890+0000","last_became_peered":"2024-09-17T04:09:39.344890+0000","last_unstale":"2024-09-17T04:11:56.725595+0000","last_undegraded":"2024-09-17T04:11:56.725595+0000","last_fullsized":"2024-09-17T04:11:56.725595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'61","last_scrub_stamp":"2024-09-17T04:11:56.725352+0000","last_deep_scrub":"29'61","last_deep_scrub_stamp":"2024-09-17T04:11:56.725352+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.725352+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:18.644323+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5380239,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":5272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'50","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.969909+0000","last_change":"2024-09-17T04:11:57.969850+0000","last_active":"2024-09-17T04:11:57.969909+0000","last_peered":"2024-09-17T04:11:57.969909+0000","last_clean":"2024-09-17T04:11:57.969909+0000","last_became_active":"2024-09-17T04:09:40.342968+0000","last_became_peered":"2024-09-17T04:09:40.342968+0000","last_unstale":"2024-09-17T04:11:57.969909+0000","last_undegraded":"2024-09-17T04:11:57.969909+0000","last_fullsized":"2024-09-17T04:11:57.969909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:57.969748+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:57.969748+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.969748+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:49.978855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'44","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.854727+0000","last_change":"2024-09-17T04:12:03.854652+0000","last_active":"2024-09-17T04:12:03.854727+0000","last_peered":"2024-09-17T04:12:03.854727+0000","last_clean":"2024-09-17T04:12:03.854727+0000","last_became_active":"2024-09-17T04:09:44.385622+0000","last_became_peered":"2024-09-17T04:09:44.385622+0000","last_unstale":"2024-09-17T04:12:03.854727+0000","last_undegraded":"2024-09-17T04:12:03.854727+0000","last_fullsized":"2024-09-17T04:12:03.854727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:12:03.854558+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:12:03.854558+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.854558+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:59.051388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'17","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.710356+0000","last_change":"2024-09-17T04:11:55.710287+0000","last_active":"2024-09-17T04:11:55.710356+0000","last_peered":"2024-09-17T04:11:55.710356+0000","last_clean":"2024-09-17T04:11:55.710356+0000","last_became_active":"2024-09-17T04:09:39.340678+0000","last_became_peered":"2024-09-17T04:09:39.340678+0000","last_unstale":"2024-09-17T04:11:55.710356+0000","last_undegraded":"2024-09-17T04:11:55.710356+0000","last_fullsized":"2024-09-17T04:11:55.710356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2024-09-17T04:11:55.710179+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2024-09-17T04:11:55.710179+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.710179+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:05.753812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.930742+0000","last_change":"2024-09-17T04:11:58.930621+0000","last_active":"2024-09-17T04:11:58.930742+0000","last_peered":"2024-09-17T04:11:58.930742+0000","last_clean":"2024-09-17T04:11:58.930742+0000","last_became_active":"2024-09-17T04:09:40.347870+0000","last_became_peered":"2024-09-17T04:09:40.347870+0000","last_unstale":"2024-09-17T04:11:58.930742+0000","last_undegraded":"2024-09-17T04:11:58.930742+0000","last_fullsized":"2024-09-17T04:11:58.930742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:58.930508+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:58.930508+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.930508+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:22.214027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'40","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.909066+0000","last_change":"2024-09-17T04:12:01.908997+0000","last_active":"2024-09-17T04:12:01.909066+0000","last_peered":"2024-09-17T04:12:01.909066+0000","last_clean":"2024-09-17T04:12:01.909066+0000","last_became_active":"2024-09-17T04:09:44.382755+0000","last_became_peered":"2024-09-17T04:09:44.382755+0000","last_unstale":"2024-09-17T04:12:01.909066+0000","last_undegraded":"2024-09-17T04:12:01.909066+0000","last_fullsized":"2024-09-17T04:12:01.909066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:01.908902+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:01.908902+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.908902+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:14.151536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'42","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.141294+0000","last_change":"2024-09-17T04:11:57.141294+0000","last_active":"2024-09-17T04:11:57.141294+0000","last_peered":"2024-09-17T04:11:57.141294+0000","last_clean":"2024-09-17T04:11:57.141294+0000","last_became_active":"2024-09-17T04:09:40.355572+0000","last_became_peered":"2024-09-17T04:09:40.355572+0000","last_unstale":"2024-09-17T04:11:57.141294+0000","last_undegraded":"2024-09-17T04:11:57.141294+0000","last_fullsized":"2024-09-17T04:11:57.141294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:57.141152+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:57.141152+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.141152+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:12.837964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'231","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.760428+0000","last_change":"2024-09-17T04:11:52.760361+0000","last_active":"2024-09-17T04:11:52.760428+0000","last_peered":"2024-09-17T04:11:52.760428+0000","last_clean":"2024-09-17T04:11:52.760428+0000","last_became_active":"2024-09-17T04:09:39.344259+0000","last_became_peered":"2024-09-17T04:09:39.344259+0000","last_unstale":"2024-09-17T04:11:52.760428+0000","last_undegraded":"2024-09-17T04:11:52.760428+0000","last_fullsized":"2024-09-17T04:11:52.760428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'231","last_scrub_stamp":"2024-09-17T04:11:52.760268+0000","last_deep_scrub":"29'231","last_deep_scrub_stamp":"2024-09-17T04:11:52.760268+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.760268+0000","objects_scrubbed":2,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.910543+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'41","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.944788+0000","last_change":"2024-09-17T04:11:58.944788+0000","last_active":"2024-09-17T04:11:58.944788+0000","last_peered":"2024-09-17T04:11:58.944788+0000","last_clean":"2024-09-17T04:11:58.944788+0000","last_became_active":"2024-09-17T04:09:44.388081+0000","last_became_peered":"2024-09-17T04:09:44.388081+0000","last_unstale":"2024-09-17T04:11:58.944788+0000","last_undegraded":"2024-09-17T04:11:58.944788+0000","last_fullsized":"2024-09-17T04:11:58.944788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-09-17T04:11:58.944696+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-09-17T04:11:58.944696+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.944696+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.434019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.181753+0000","last_change":"2024-09-17T04:11:55.181639+0000","last_active":"2024-09-17T04:11:55.181753+0000","last_peered":"2024-09-17T04:11:55.181753+0000","last_clean":"2024-09-17T04:11:55.181753+0000","last_became_active":"2024-09-17T04:09:40.357139+0000","last_became_peered":"2024-09-17T04:09:40.357139+0000","last_unstale":"2024-09-17T04:11:55.181753+0000","last_undegraded":"2024-09-17T04:11:55.181753+0000","last_fullsized":"2024-09-17T04:11:55.181753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:55.181515+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:55.181515+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.181515+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:05.684333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'31","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.600576+0000","last_change":"2024-09-17T04:11:50.600471+0000","last_active":"2024-09-17T04:11:50.600576+0000","last_peered":"2024-09-17T04:11:50.600576+0000","last_clean":"2024-09-17T04:11:50.600576+0000","last_became_active":"2024-09-17T04:09:39.337103+0000","last_became_peered":"2024-09-17T04:09:39.337103+0000","last_unstale":"2024-09-17T04:11:50.600576+0000","last_undegraded":"2024-09-17T04:11:50.600576+0000","last_fullsized":"2024-09-17T04:11:50.600576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-09-17T04:11:50.600349+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-09-17T04:11:50.600349+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.600349+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.425528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.911083+0000","last_change":"2024-09-17T04:11:57.911000+0000","last_active":"2024-09-17T04:11:57.911083+0000","last_peered":"2024-09-17T04:11:57.911083+0000","last_clean":"2024-09-17T04:11:57.911083+0000","last_became_active":"2024-09-17T04:09:44.388681+0000","last_became_peered":"2024-09-17T04:09:44.388681+0000","last_unstale":"2024-09-17T04:11:57.911083+0000","last_undegraded":"2024-09-17T04:11:57.911083+0000","last_fullsized":"2024-09-17T04:11:57.911083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:57.910896+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:57.910896+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.910896+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:08.249762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.182329+0000","last_change":"2024-09-17T04:11:52.182237+0000","last_active":"2024-09-17T04:11:52.182329+0000","last_peered":"2024-09-17T04:11:52.182329+0000","last_clean":"2024-09-17T04:11:52.182329+0000","last_became_active":"2024-09-17T04:09:40.351393+0000","last_became_peered":"2024-09-17T04:09:40.351393+0000","last_unstale":"2024-09-17T04:11:52.182329+0000","last_undegraded":"2024-09-17T04:11:52.182329+0000","last_fullsized":"2024-09-17T04:11:52.182329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:52.182115+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:52.182115+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.182115+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:04.424749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.612560+0000","last_change":"2024-09-17T04:11:51.612560+0000","last_active":"2024-09-17T04:11:51.612560+0000","last_peered":"2024-09-17T04:11:51.612560+0000","last_clean":"2024-09-17T04:11:51.612560+0000","last_became_active":"2024-09-17T04:09:39.338583+0000","last_became_peered":"2024-09-17T04:09:39.338583+0000","last_unstale":"2024-09-17T04:11:51.612560+0000","last_undegraded":"2024-09-17T04:11:51.612560+0000","last_fullsized":"2024-09-17T04:11:51.612560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.612431+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.612431+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.612431+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:25.869131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'40","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.575161+0000","last_change":"2024-09-17T04:12:03.575161+0000","last_active":"2024-09-17T04:12:03.575161+0000","last_peered":"2024-09-17T04:12:03.575161+0000","last_clean":"2024-09-17T04:12:03.575161+0000","last_became_active":"2024-09-17T04:09:44.491037+0000","last_became_peered":"2024-09-17T04:09:44.491037+0000","last_unstale":"2024-09-17T04:12:03.575161+0000","last_undegraded":"2024-09-17T04:12:03.575161+0000","last_fullsized":"2024-09-17T04:12:03.575161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:03.575062+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:03.575062+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.575062+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:41.193729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.959649+0000","last_change":"2024-09-17T04:11:50.959581+0000","last_active":"2024-09-17T04:11:50.959649+0000","last_peered":"2024-09-17T04:11:50.959649+0000","last_clean":"2024-09-17T04:11:50.959649+0000","last_became_active":"2024-09-17T04:09:40.347416+0000","last_became_peered":"2024-09-17T04:09:40.347416+0000","last_unstale":"2024-09-17T04:11:50.959649+0000","last_undegraded":"2024-09-17T04:11:50.959649+0000","last_fullsized":"2024-09-17T04:11:50.959649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:11:50.959454+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:11:50.959454+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.959454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:27.670230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.758559+0000","last_change":"2024-09-17T04:11:57.758559+0000","last_active":"2024-09-17T04:11:57.758559+0000","last_peered":"2024-09-17T04:11:57.758559+0000","last_clean":"2024-09-17T04:11:57.758559+0000","last_became_active":"2024-09-17T04:09:39.338828+0000","last_became_peered":"2024-09-17T04:09:39.338828+0000","last_unstale":"2024-09-17T04:11:57.758559+0000","last_undegraded":"2024-09-17T04:11:57.758559+0000","last_fullsized":"2024-09-17T04:11:57.758559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:57.758443+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:57.758443+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.758443+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.213648+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'42","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.933578+0000","last_change":"2024-09-17T04:11:59.933578+0000","last_active":"2024-09-17T04:11:59.933578+0000","last_peered":"2024-09-17T04:11:59.933578+0000","last_clean":"2024-09-17T04:11:59.933578+0000","last_became_active":"2024-09-17T04:09:44.388149+0000","last_became_peered":"2024-09-17T04:09:44.388149+0000","last_unstale":"2024-09-17T04:11:59.933578+0000","last_undegraded":"2024-09-17T04:11:59.933578+0000","last_fullsized":"2024-09-17T04:11:59.933578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:59.933470+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:59.933470+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.933470+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:09.665628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.647481+0000","last_change":"2024-09-17T04:11:49.647394+0000","last_active":"2024-09-17T04:11:49.647481+0000","last_peered":"2024-09-17T04:11:49.647481+0000","last_clean":"2024-09-17T04:11:49.647481+0000","last_became_active":"2024-09-17T04:09:40.345805+0000","last_became_peered":"2024-09-17T04:09:40.345805+0000","last_unstale":"2024-09-17T04:11:49.647481+0000","last_undegraded":"2024-09-17T04:11:49.647481+0000","last_fullsized":"2024-09-17T04:11:49.647481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:49.647318+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:49.647318+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.647318+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:44.035580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'27","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.239492+0000","last_change":"2024-09-17T04:11:54.239492+0000","last_active":"2024-09-17T04:11:54.239492+0000","last_peered":"2024-09-17T04:11:54.239492+0000","last_clean":"2024-09-17T04:11:54.239492+0000","last_became_active":"2024-09-17T04:09:39.341082+0000","last_became_peered":"2024-09-17T04:09:39.341082+0000","last_unstale":"2024-09-17T04:11:54.239492+0000","last_undegraded":"2024-09-17T04:11:54.239492+0000","last_fullsized":"2024-09-17T04:11:54.239492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2024-09-17T04:11:54.239402+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2024-09-17T04:11:54.239402+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.239402+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:48.627663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'46","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.927409+0000","last_change":"2024-09-17T04:11:55.927409+0000","last_active":"2024-09-17T04:11:55.927409+0000","last_peered":"2024-09-17T04:11:55.927409+0000","last_clean":"2024-09-17T04:11:55.927409+0000","last_became_active":"2024-09-17T04:09:44.492111+0000","last_became_peered":"2024-09-17T04:09:44.492111+0000","last_unstale":"2024-09-17T04:11:55.927409+0000","last_undegraded":"2024-09-17T04:11:55.927409+0000","last_fullsized":"2024-09-17T04:11:55.927409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:55.927273+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:55.927273+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.927273+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:27.221742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.225252+0000","last_change":"2024-09-17T04:11:54.225252+0000","last_active":"2024-09-17T04:11:54.225252+0000","last_peered":"2024-09-17T04:11:54.225252+0000","last_clean":"2024-09-17T04:11:54.225252+0000","last_became_active":"2024-09-17T04:09:40.359946+0000","last_became_peered":"2024-09-17T04:09:40.359946+0000","last_unstale":"2024-09-17T04:11:54.225252+0000","last_undegraded":"2024-09-17T04:11:54.225252+0000","last_fullsized":"2024-09-17T04:11:54.225252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:54.225152+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:54.225152+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.225152+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:28.017175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'51","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.591009+0000","last_change":"2024-09-17T04:11:48.590908+0000","last_active":"2024-09-17T04:11:48.591009+0000","last_peered":"2024-09-17T04:11:48.591009+0000","last_clean":"2024-09-17T04:11:48.591009+0000","last_became_active":"2024-09-17T04:09:39.343563+0000","last_became_peered":"2024-09-17T04:09:39.343563+0000","last_unstale":"2024-09-17T04:11:48.591009+0000","last_undegraded":"2024-09-17T04:11:48.591009+0000","last_fullsized":"2024-09-17T04:11:48.591009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:48.590791+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:48.590791+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.590791+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:04.333328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'51","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.228787+0000","last_change":"2024-09-17T04:12:04.228787+0000","last_active":"2024-09-17T04:12:04.228787+0000","last_peered":"2024-09-17T04:12:04.228787+0000","last_clean":"2024-09-17T04:12:04.228787+0000","last_became_active":"2024-09-17T04:09:44.493366+0000","last_became_peered":"2024-09-17T04:09:44.493366+0000","last_unstale":"2024-09-17T04:12:04.228787+0000","last_undegraded":"2024-09-17T04:12:04.228787+0000","last_fullsized":"2024-09-17T04:12:04.228787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:04.228655+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:04.228655+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.228655+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:53.586447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'45","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.658856+0000","last_change":"2024-09-17T04:11:55.658856+0000","last_active":"2024-09-17T04:11:55.658856+0000","last_peered":"2024-09-17T04:11:55.658856+0000","last_clean":"2024-09-17T04:11:55.658856+0000","last_became_active":"2024-09-17T04:09:40.343041+0000","last_became_peered":"2024-09-17T04:09:40.343041+0000","last_unstale":"2024-09-17T04:11:55.658856+0000","last_undegraded":"2024-09-17T04:11:55.658856+0000","last_fullsized":"2024-09-17T04:11:55.658856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:55.658764+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:55.658764+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.658764+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:28.503626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'28","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.719967+0000","last_change":"2024-09-17T04:11:51.719967+0000","last_active":"2024-09-17T04:11:51.719967+0000","last_peered":"2024-09-17T04:11:51.719967+0000","last_clean":"2024-09-17T04:11:51.719967+0000","last_became_active":"2024-09-17T04:09:39.338322+0000","last_became_peered":"2024-09-17T04:09:39.338322+0000","last_unstale":"2024-09-17T04:11:51.719967+0000","last_undegraded":"2024-09-17T04:11:51.719967+0000","last_fullsized":"2024-09-17T04:11:51.719967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-09-17T04:11:51.719849+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-09-17T04:11:51.719849+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.719849+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:46.108110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.629513+0000","last_change":"2024-09-17T04:12:01.629513+0000","last_active":"2024-09-17T04:12:01.629513+0000","last_peered":"2024-09-17T04:12:01.629513+0000","last_clean":"2024-09-17T04:12:01.629513+0000","last_became_active":"2024-09-17T04:09:44.492212+0000","last_became_peered":"2024-09-17T04:09:44.492212+0000","last_unstale":"2024-09-17T04:12:01.629513+0000","last_undegraded":"2024-09-17T04:12:01.629513+0000","last_fullsized":"2024-09-17T04:12:01.629513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:01.629416+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:01.629416+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.629416+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:29.265618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'46","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.891073+0000","last_change":"2024-09-17T04:11:54.891005+0000","last_active":"2024-09-17T04:11:54.891073+0000","last_peered":"2024-09-17T04:11:54.891073+0000","last_clean":"2024-09-17T04:11:54.891073+0000","last_became_active":"2024-09-17T04:10:20.524068+0000","last_became_peered":"2024-09-17T04:10:20.524068+0000","last_unstale":"2024-09-17T04:11:54.891073+0000","last_undegraded":"2024-09-17T04:11:54.891073+0000","last_fullsized":"2024-09-17T04:11:54.891073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:54.890896+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:54.890896+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.890896+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:29.453435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'22","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.558238+0000","last_change":"2024-09-17T04:11:49.558238+0000","last_active":"2024-09-17T04:11:49.558238+0000","last_peered":"2024-09-17T04:11:49.558238+0000","last_clean":"2024-09-17T04:11:49.558238+0000","last_became_active":"2024-09-17T04:09:39.335190+0000","last_became_peered":"2024-09-17T04:09:39.335190+0000","last_unstale":"2024-09-17T04:11:49.558238+0000","last_undegraded":"2024-09-17T04:11:49.558238+0000","last_fullsized":"2024-09-17T04:11:49.558238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-09-17T04:11:49.558119+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-09-17T04:11:49.558119+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.558119+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:48.445243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'45","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.626422+0000","last_change":"2024-09-17T04:11:58.626422+0000","last_active":"2024-09-17T04:11:58.626422+0000","last_peered":"2024-09-17T04:11:58.626422+0000","last_clean":"2024-09-17T04:11:58.626422+0000","last_became_active":"2024-09-17T04:09:44.393457+0000","last_became_peered":"2024-09-17T04:09:44.393457+0000","last_unstale":"2024-09-17T04:11:58.626422+0000","last_undegraded":"2024-09-17T04:11:58.626422+0000","last_fullsized":"2024-09-17T04:11:58.626422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:58.626320+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:58.626320+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.626320+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:35.613693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.943106+0000","last_change":"2024-09-17T04:11:49.943106+0000","last_active":"2024-09-17T04:11:49.943106+0000","last_peered":"2024-09-17T04:11:49.943106+0000","last_clean":"2024-09-17T04:11:49.943106+0000","last_became_active":"2024-09-17T04:09:40.340885+0000","last_became_peered":"2024-09-17T04:09:40.340885+0000","last_unstale":"2024-09-17T04:11:49.943106+0000","last_undegraded":"2024-09-17T04:11:49.943106+0000","last_fullsized":"2024-09-17T04:11:49.943106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:49.942975+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:49.942975+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.942975+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:49.063518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.993698+0000","last_change":"2024-09-17T04:11:51.993698+0000","last_active":"2024-09-17T04:11:51.993698+0000","last_peered":"2024-09-17T04:11:51.993698+0000","last_clean":"2024-09-17T04:11:51.993698+0000","last_became_active":"2024-09-17T04:09:39.340137+0000","last_became_peered":"2024-09-17T04:09:39.340137+0000","last_unstale":"2024-09-17T04:11:51.993698+0000","last_undegraded":"2024-09-17T04:11:51.993698+0000","last_fullsized":"2024-09-17T04:11:51.993698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:51.993613+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:51.993613+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.993613+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:55.828485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.564631+0000","last_change":"2024-09-17T04:12:00.564631+0000","last_active":"2024-09-17T04:12:00.564631+0000","last_peered":"2024-09-17T04:12:00.564631+0000","last_clean":"2024-09-17T04:12:00.564631+0000","last_became_active":"2024-09-17T04:09:44.391316+0000","last_became_peered":"2024-09-17T04:09:44.391316+0000","last_unstale":"2024-09-17T04:12:00.564631+0000","last_undegraded":"2024-09-17T04:12:00.564631+0000","last_fullsized":"2024-09-17T04:12:00.564631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:00.564535+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:00.564535+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.564535+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:50.166069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'45","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.660027+0000","last_change":"2024-09-17T04:11:54.660027+0000","last_active":"2024-09-17T04:11:54.660027+0000","last_peered":"2024-09-17T04:11:54.660027+0000","last_clean":"2024-09-17T04:11:54.660027+0000","last_became_active":"2024-09-17T04:09:40.337752+0000","last_became_peered":"2024-09-17T04:09:40.337752+0000","last_unstale":"2024-09-17T04:11:54.660027+0000","last_undegraded":"2024-09-17T04:11:54.660027+0000","last_fullsized":"2024-09-17T04:11:54.660027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:11:54.659925+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:11:54.659925+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.659925+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:45.383283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'56","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.857553+0000","last_change":"2024-09-17T04:11:48.857553+0000","last_active":"2024-09-17T04:11:48.857553+0000","last_peered":"2024-09-17T04:11:48.857553+0000","last_clean":"2024-09-17T04:11:48.857553+0000","last_became_active":"2024-09-17T04:09:39.336885+0000","last_became_peered":"2024-09-17T04:09:39.336885+0000","last_unstale":"2024-09-17T04:11:48.857553+0000","last_undegraded":"2024-09-17T04:11:48.857553+0000","last_fullsized":"2024-09-17T04:11:48.857553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2024-09-17T04:11:48.857469+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2024-09-17T04:11:48.857469+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.857469+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:36.227252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":27,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'49","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.584663+0000","last_change":"2024-09-17T04:12:02.584663+0000","last_active":"2024-09-17T04:12:02.584663+0000","last_peered":"2024-09-17T04:12:02.584663+0000","last_clean":"2024-09-17T04:12:02.584663+0000","last_became_active":"2024-09-17T04:09:44.391994+0000","last_became_peered":"2024-09-17T04:09:44.391994+0000","last_unstale":"2024-09-17T04:12:02.584663+0000","last_undegraded":"2024-09-17T04:12:02.584663+0000","last_fullsized":"2024-09-17T04:12:02.584663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:12:02.584533+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:12:02.584533+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.584533+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:48.426323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:48.650353+0000","last_change":"2024-09-17T04:11:48.650353+0000","last_active":"2024-09-17T04:11:48.650353+0000","last_peered":"2024-09-17T04:11:48.650353+0000","last_clean":"2024-09-17T04:11:48.650353+0000","last_became_active":"2024-09-17T04:09:40.338921+0000","last_became_peered":"2024-09-17T04:09:40.338921+0000","last_unstale":"2024-09-17T04:11:48.650353+0000","last_undegraded":"2024-09-17T04:11:48.650353+0000","last_fullsized":"2024-09-17T04:11:48.650353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:48.650278+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:48.650278+0000","last_clean_scrub_stamp":"2024-09-17T04:11:48.650278+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:58.717786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.746928+0000","last_change":"2024-09-17T04:11:53.746928+0000","last_active":"2024-09-17T04:11:53.746928+0000","last_peered":"2024-09-17T04:11:53.746928+0000","last_clean":"2024-09-17T04:11:53.746928+0000","last_became_active":"2024-09-17T04:09:39.339168+0000","last_became_peered":"2024-09-17T04:09:39.339168+0000","last_unstale":"2024-09-17T04:11:53.746928+0000","last_undegraded":"2024-09-17T04:11:53.746928+0000","last_fullsized":"2024-09-17T04:11:53.746928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:53.746822+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:53.746822+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.746822+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:21.153984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.682059+0000","last_change":"2024-09-17T04:11:58.682059+0000","last_active":"2024-09-17T04:11:58.682059+0000","last_peered":"2024-09-17T04:11:58.682059+0000","last_clean":"2024-09-17T04:11:58.682059+0000","last_became_active":"2024-09-17T04:09:44.490213+0000","last_became_peered":"2024-09-17T04:09:44.490213+0000","last_unstale":"2024-09-17T04:11:58.682059+0000","last_undegraded":"2024-09-17T04:11:58.682059+0000","last_fullsized":"2024-09-17T04:11:58.682059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:11:58.681918+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:11:58.681918+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.681918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:22.744686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'57","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.917685+0000","last_change":"2024-09-17T04:11:52.917616+0000","last_active":"2024-09-17T04:11:52.917685+0000","last_peered":"2024-09-17T04:11:52.917685+0000","last_clean":"2024-09-17T04:11:52.917685+0000","last_became_active":"2024-09-17T04:10:20.523913+0000","last_became_peered":"2024-09-17T04:10:20.523913+0000","last_unstale":"2024-09-17T04:11:52.917685+0000","last_undegraded":"2024-09-17T04:11:52.917685+0000","last_fullsized":"2024-09-17T04:11:52.917685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-09-17T04:11:52.917516+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-09-17T04:11:52.917516+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.917516+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:48.739475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.014872+0000","last_change":"2024-09-17T04:11:51.014872+0000","last_active":"2024-09-17T04:11:51.014872+0000","last_peered":"2024-09-17T04:11:51.014872+0000","last_clean":"2024-09-17T04:11:51.014872+0000","last_became_active":"2024-09-17T04:09:39.338007+0000","last_became_peered":"2024-09-17T04:09:39.338007+0000","last_unstale":"2024-09-17T04:11:51.014872+0000","last_undegraded":"2024-09-17T04:11:51.014872+0000","last_fullsized":"2024-09-17T04:11:51.014872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-17T04:11:51.014706+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-17T04:11:51.014706+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.014706+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:06.711517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":134,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.727694+0000","last_change":"2024-09-17T04:11:54.727694+0000","last_active":"2024-09-17T04:11:54.727694+0000","last_peered":"2024-09-17T04:11:54.727694+0000","last_clean":"2024-09-17T04:11:54.727694+0000","last_became_active":"2024-09-17T04:09:31.131592+0000","last_became_peered":"2024-09-17T04:09:31.131592+0000","last_unstale":"2024-09-17T04:11:54.727694+0000","last_undegraded":"2024-09-17T04:11:54.727694+0000","last_fullsized":"2024-09-17T04:11:54.727694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-09-17T04:11:54.727562+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-09-17T04:11:54.727562+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.727562+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.889563+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'35","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.232983+0000","last_change":"2024-09-17T04:12:05.232983+0000","last_active":"2024-09-17T04:12:05.232983+0000","last_peered":"2024-09-17T04:12:05.232983+0000","last_clean":"2024-09-17T04:12:05.232983+0000","last_became_active":"2024-09-17T04:09:44.494282+0000","last_became_peered":"2024-09-17T04:09:44.494282+0000","last_unstale":"2024-09-17T04:12:05.232983+0000","last_undegraded":"2024-09-17T04:12:05.232983+0000","last_fullsized":"2024-09-17T04:12:05.232983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-09-17T04:12:05.232864+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-09-17T04:12:05.232864+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.232864+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:28.516383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'46","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.755626+0000","last_change":"2024-09-17T04:11:58.755626+0000","last_active":"2024-09-17T04:11:58.755626+0000","last_peered":"2024-09-17T04:11:58.755626+0000","last_clean":"2024-09-17T04:11:58.755626+0000","last_became_active":"2024-09-17T04:09:40.364651+0000","last_became_peered":"2024-09-17T04:09:40.364651+0000","last_unstale":"2024-09-17T04:11:58.755626+0000","last_undegraded":"2024-09-17T04:11:58.755626+0000","last_fullsized":"2024-09-17T04:11:58.755626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-09-17T04:11:58.755505+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-09-17T04:11:58.755505+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.755505+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:58.084867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.878523+0000","last_change":"2024-09-17T04:11:53.878523+0000","last_active":"2024-09-17T04:11:53.878523+0000","last_peered":"2024-09-17T04:11:53.878523+0000","last_clean":"2024-09-17T04:11:53.878523+0000","last_became_active":"2024-09-17T04:09:39.339833+0000","last_became_peered":"2024-09-17T04:09:39.339833+0000","last_unstale":"2024-09-17T04:11:53.878523+0000","last_undegraded":"2024-09-17T04:11:53.878523+0000","last_fullsized":"2024-09-17T04:11:53.878523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-17T04:11:53.878425+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-17T04:11:53.878425+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.878425+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:01.609091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'34","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.170624+0000","last_change":"2024-09-17T04:12:03.170624+0000","last_active":"2024-09-17T04:12:03.170624+0000","last_peered":"2024-09-17T04:12:03.170624+0000","last_clean":"2024-09-17T04:12:03.170624+0000","last_became_active":"2024-09-17T04:10:20.776694+0000","last_became_peered":"2024-09-17T04:10:20.776694+0000","last_unstale":"2024-09-17T04:12:03.170624+0000","last_undegraded":"2024-09-17T04:12:03.170624+0000","last_fullsized":"2024-09-17T04:12:03.170624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-09-17T04:12:03.170503+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-09-17T04:12:03.170503+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.170503+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:44.768280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.970677+0000","last_change":"2024-09-17T04:11:56.970599+0000","last_active":"2024-09-17T04:11:56.970677+0000","last_peered":"2024-09-17T04:11:56.970677+0000","last_clean":"2024-09-17T04:11:56.970677+0000","last_became_active":"2024-09-17T04:09:40.352049+0000","last_became_peered":"2024-09-17T04:09:40.352049+0000","last_unstale":"2024-09-17T04:11:56.970677+0000","last_undegraded":"2024-09-17T04:11:56.970677+0000","last_fullsized":"2024-09-17T04:11:56.970677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:56.970491+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:56.970491+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.970491+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:26.796879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'25","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.598219+0000","last_change":"2024-09-17T04:11:52.598157+0000","last_active":"2024-09-17T04:11:52.598219+0000","last_peered":"2024-09-17T04:11:52.598219+0000","last_clean":"2024-09-17T04:11:52.598219+0000","last_became_active":"2024-09-17T04:09:39.330226+0000","last_became_peered":"2024-09-17T04:09:39.330226+0000","last_unstale":"2024-09-17T04:11:52.598219+0000","last_undegraded":"2024-09-17T04:11:52.598219+0000","last_fullsized":"2024-09-17T04:11:52.598219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2024-09-17T04:11:52.598068+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2024-09-17T04:11:52.598068+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.598068+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:33.639187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'55","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.545181+0000","last_change":"2024-09-17T04:12:04.545181+0000","last_active":"2024-09-17T04:12:04.545181+0000","last_peered":"2024-09-17T04:12:04.545181+0000","last_clean":"2024-09-17T04:12:04.545181+0000","last_became_active":"2024-09-17T04:09:44.388755+0000","last_became_peered":"2024-09-17T04:09:44.388755+0000","last_unstale":"2024-09-17T04:12:04.545181+0000","last_undegraded":"2024-09-17T04:12:04.545181+0000","last_fullsized":"2024-09-17T04:12:04.545181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:04.545039+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:04.545039+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.545039+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:19.156448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'47","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.777065+0000","last_change":"2024-09-17T04:11:59.777065+0000","last_active":"2024-09-17T04:11:59.777065+0000","last_peered":"2024-09-17T04:11:59.777065+0000","last_clean":"2024-09-17T04:11:59.777065+0000","last_became_active":"2024-09-17T04:09:40.363316+0000","last_became_peered":"2024-09-17T04:09:40.363316+0000","last_unstale":"2024-09-17T04:11:59.777065+0000","last_undegraded":"2024-09-17T04:11:59.777065+0000","last_fullsized":"2024-09-17T04:11:59.777065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:11:59.776937+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:11:59.776937+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.776937+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:59.267334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.885415+0000","last_change":"2024-09-17T04:11:51.885360+0000","last_active":"2024-09-17T04:11:51.885415+0000","last_peered":"2024-09-17T04:11:51.885415+0000","last_clean":"2024-09-17T04:11:51.885415+0000","last_became_active":"2024-09-17T04:09:39.339217+0000","last_became_peered":"2024-09-17T04:09:39.339217+0000","last_unstale":"2024-09-17T04:11:51.885415+0000","last_undegraded":"2024-09-17T04:11:51.885415+0000","last_fullsized":"2024-09-17T04:11:51.885415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-09-17T04:11:51.885287+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-09-17T04:11:51.885287+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.885287+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:52.086151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'50","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.021996+0000","last_change":"2024-09-17T04:12:06.021996+0000","last_active":"2024-09-17T04:12:06.021996+0000","last_peered":"2024-09-17T04:12:06.021996+0000","last_clean":"2024-09-17T04:12:06.021996+0000","last_became_active":"2024-09-17T04:09:44.490760+0000","last_became_peered":"2024-09-17T04:09:44.490760+0000","last_unstale":"2024-09-17T04:12:06.021996+0000","last_undegraded":"2024-09-17T04:12:06.021996+0000","last_fullsized":"2024-09-17T04:12:06.021996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:06.021856+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:06.021856+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.021856+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:30.968818+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'39","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.748158+0000","last_change":"2024-09-17T04:12:01.748158+0000","last_active":"2024-09-17T04:12:01.748158+0000","last_peered":"2024-09-17T04:12:01.748158+0000","last_clean":"2024-09-17T04:12:01.748158+0000","last_became_active":"2024-09-17T04:09:40.364090+0000","last_became_peered":"2024-09-17T04:09:40.364090+0000","last_unstale":"2024-09-17T04:12:01.748158+0000","last_undegraded":"2024-09-17T04:12:01.748158+0000","last_fullsized":"2024-09-17T04:12:01.748158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-09-17T04:12:01.748059+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-09-17T04:12:01.748059+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.748059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.810827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.979572+0000","last_change":"2024-09-17T04:11:51.979495+0000","last_active":"2024-09-17T04:11:51.979572+0000","last_peered":"2024-09-17T04:11:51.979572+0000","last_clean":"2024-09-17T04:11:51.979572+0000","last_became_active":"2024-09-17T04:09:39.335087+0000","last_became_peered":"2024-09-17T04:09:39.335087+0000","last_unstale":"2024-09-17T04:11:51.979572+0000","last_undegraded":"2024-09-17T04:11:51.979572+0000","last_fullsized":"2024-09-17T04:11:51.979572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:51.979391+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:51.979391+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.979391+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.623637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'47","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.923822+0000","last_change":"2024-09-17T04:11:56.923822+0000","last_active":"2024-09-17T04:11:56.923822+0000","last_peered":"2024-09-17T04:11:56.923822+0000","last_clean":"2024-09-17T04:11:56.923822+0000","last_became_active":"2024-09-17T04:09:44.387779+0000","last_became_peered":"2024-09-17T04:09:44.387779+0000","last_unstale":"2024-09-17T04:11:56.923822+0000","last_undegraded":"2024-09-17T04:11:56.923822+0000","last_fullsized":"2024-09-17T04:11:56.923822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:11:56.923711+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:11:56.923711+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.923711+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:52.476314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'47","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.789148+0000","last_change":"2024-09-17T04:12:00.789059+0000","last_active":"2024-09-17T04:12:00.789148+0000","last_peered":"2024-09-17T04:12:00.789148+0000","last_clean":"2024-09-17T04:12:00.789148+0000","last_became_active":"2024-09-17T04:09:40.362834+0000","last_became_peered":"2024-09-17T04:09:40.362834+0000","last_unstale":"2024-09-17T04:12:00.789148+0000","last_undegraded":"2024-09-17T04:12:00.789148+0000","last_fullsized":"2024-09-17T04:12:00.789148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-09-17T04:12:00.788956+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-09-17T04:12:00.788956+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.788956+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:30.615344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'37","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.909958+0000","last_change":"2024-09-17T04:11:50.909884+0000","last_active":"2024-09-17T04:11:50.909958+0000","last_peered":"2024-09-17T04:11:50.909958+0000","last_clean":"2024-09-17T04:11:50.909958+0000","last_became_active":"2024-09-17T04:09:39.332957+0000","last_became_peered":"2024-09-17T04:09:39.332957+0000","last_unstale":"2024-09-17T04:11:50.909958+0000","last_undegraded":"2024-09-17T04:11:50.909958+0000","last_fullsized":"2024-09-17T04:11:50.909958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-17T04:11:50.909778+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-17T04:11:50.909778+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.909778+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:12.017485+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'54","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.622174+0000","last_change":"2024-09-17T04:12:02.622101+0000","last_active":"2024-09-17T04:12:02.622174+0000","last_peered":"2024-09-17T04:12:02.622174+0000","last_clean":"2024-09-17T04:12:02.622174+0000","last_became_active":"2024-09-17T04:09:44.395090+0000","last_became_peered":"2024-09-17T04:09:44.395090+0000","last_unstale":"2024-09-17T04:12:02.622174+0000","last_undegraded":"2024-09-17T04:12:02.622174+0000","last_fullsized":"2024-09-17T04:12:02.622174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:02.622010+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:02.622010+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.622010+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:30.361298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.187372+0000","last_change":"2024-09-17T04:11:56.187292+0000","last_active":"2024-09-17T04:11:56.187372+0000","last_peered":"2024-09-17T04:11:56.187372+0000","last_clean":"2024-09-17T04:11:56.187372+0000","last_became_active":"2024-09-17T04:09:40.359779+0000","last_became_peered":"2024-09-17T04:09:40.359779+0000","last_unstale":"2024-09-17T04:11:56.187372+0000","last_undegraded":"2024-09-17T04:11:56.187372+0000","last_fullsized":"2024-09-17T04:11:56.187372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:56.187192+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:56.187192+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.187192+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:23.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'30","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.220399+0000","last_change":"2024-09-17T04:11:55.220290+0000","last_active":"2024-09-17T04:11:55.220399+0000","last_peered":"2024-09-17T04:11:55.220399+0000","last_clean":"2024-09-17T04:11:55.220399+0000","last_became_active":"2024-09-17T04:09:39.341047+0000","last_became_peered":"2024-09-17T04:09:39.341047+0000","last_unstale":"2024-09-17T04:11:55.220399+0000","last_undegraded":"2024-09-17T04:11:55.220399+0000","last_fullsized":"2024-09-17T04:11:55.220399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-09-17T04:11:55.220167+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-09-17T04:11:55.220167+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.220167+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:40.370442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'43","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.266508+0000","last_change":"2024-09-17T04:12:07.266441+0000","last_active":"2024-09-17T04:12:07.266508+0000","last_peered":"2024-09-17T04:12:07.266508+0000","last_clean":"2024-09-17T04:12:07.266508+0000","last_became_active":"2024-09-17T04:10:20.774882+0000","last_became_peered":"2024-09-17T04:10:20.774882+0000","last_unstale":"2024-09-17T04:12:07.266508+0000","last_undegraded":"2024-09-17T04:12:07.266508+0000","last_fullsized":"2024-09-17T04:12:07.266508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:07.266364+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:07.266364+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.266364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:47.710044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'63","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.786435+0000","last_change":"2024-09-17T04:12:02.786329+0000","last_active":"2024-09-17T04:12:02.786435+0000","last_peered":"2024-09-17T04:12:02.786435+0000","last_clean":"2024-09-17T04:12:02.786435+0000","last_became_active":"2024-09-17T04:09:40.363605+0000","last_became_peered":"2024-09-17T04:09:40.363605+0000","last_unstale":"2024-09-17T04:12:02.786435+0000","last_undegraded":"2024-09-17T04:12:02.786435+0000","last_fullsized":"2024-09-17T04:12:02.786435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-09-17T04:12:02.786224+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-09-17T04:12:02.786224+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.786224+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:26.069743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'35","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.009676+0000","last_change":"2024-09-17T04:11:53.009616+0000","last_active":"2024-09-17T04:11:53.009676+0000","last_peered":"2024-09-17T04:11:53.009676+0000","last_clean":"2024-09-17T04:11:53.009676+0000","last_became_active":"2024-09-17T04:09:39.339470+0000","last_became_peered":"2024-09-17T04:09:39.339470+0000","last_unstale":"2024-09-17T04:11:53.009676+0000","last_undegraded":"2024-09-17T04:11:53.009676+0000","last_fullsized":"2024-09-17T04:11:53.009676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2024-09-17T04:11:53.009529+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2024-09-17T04:11:53.009529+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.009529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:14.928500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'34","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.252213+0000","last_change":"2024-09-17T04:12:06.252213+0000","last_active":"2024-09-17T04:12:06.252213+0000","last_peered":"2024-09-17T04:12:06.252213+0000","last_clean":"2024-09-17T04:12:06.252213+0000","last_became_active":"2024-09-17T04:09:44.490613+0000","last_became_peered":"2024-09-17T04:09:44.490613+0000","last_unstale":"2024-09-17T04:12:06.252213+0000","last_undegraded":"2024-09-17T04:12:06.252213+0000","last_fullsized":"2024-09-17T04:12:06.252213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2024-09-17T04:12:06.252145+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2024-09-17T04:12:06.252145+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.252145+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:59.811253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:50.686609+0000","last_change":"2024-09-17T04:11:50.686554+0000","last_active":"2024-09-17T04:11:50.686609+0000","last_peered":"2024-09-17T04:11:50.686609+0000","last_clean":"2024-09-17T04:11:50.686609+0000","last_became_active":"2024-09-17T04:09:40.355247+0000","last_became_peered":"2024-09-17T04:09:40.355247+0000","last_unstale":"2024-09-17T04:11:50.686609+0000","last_undegraded":"2024-09-17T04:11:50.686609+0000","last_fullsized":"2024-09-17T04:11:50.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:50.686485+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:50.686485+0000","last_clean_scrub_stamp":"2024-09-17T04:11:50.686485+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:35.836760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.766736+0000","last_change":"2024-09-17T04:11:53.766672+0000","last_active":"2024-09-17T04:11:53.766736+0000","last_peered":"2024-09-17T04:11:53.766736+0000","last_clean":"2024-09-17T04:11:53.766736+0000","last_became_active":"2024-09-17T04:09:39.337791+0000","last_became_peered":"2024-09-17T04:09:39.337791+0000","last_unstale":"2024-09-17T04:11:53.766736+0000","last_undegraded":"2024-09-17T04:11:53.766736+0000","last_fullsized":"2024-09-17T04:11:53.766736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-17T04:11:53.766590+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-17T04:11:53.766590+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.766590+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:03.810223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'38","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.039102+0000","last_change":"2024-09-17T04:12:07.039009+0000","last_active":"2024-09-17T04:12:07.039102+0000","last_peered":"2024-09-17T04:12:07.039102+0000","last_clean":"2024-09-17T04:12:07.039102+0000","last_became_active":"2024-09-17T04:09:44.490996+0000","last_became_peered":"2024-09-17T04:09:44.490996+0000","last_unstale":"2024-09-17T04:12:07.039102+0000","last_undegraded":"2024-09-17T04:12:07.039102+0000","last_fullsized":"2024-09-17T04:12:07.039102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-09-17T04:12:07.038889+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-09-17T04:12:07.038889+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.038889+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:18.160150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.753789+0000","last_change":"2024-09-17T04:12:03.753714+0000","last_active":"2024-09-17T04:12:03.753789+0000","last_peered":"2024-09-17T04:12:03.753789+0000","last_clean":"2024-09-17T04:12:03.753789+0000","last_became_active":"2024-09-17T04:09:40.361623+0000","last_became_peered":"2024-09-17T04:09:40.361623+0000","last_unstale":"2024-09-17T04:12:03.753789+0000","last_undegraded":"2024-09-17T04:12:03.753789+0000","last_fullsized":"2024-09-17T04:12:03.753789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:03.753609+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:03.753609+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.753609+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:37.104636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1193","reported_seq":1229,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.217566+0000","last_change":"2024-09-17T04:11:51.217499+0000","last_active":"2024-09-17T04:11:51.217566+0000","last_peered":"2024-09-17T04:11:51.217566+0000","last_clean":"2024-09-17T04:11:51.217566+0000","last_became_active":"2024-09-17T04:09:39.341509+0000","last_became_peered":"2024-09-17T04:09:39.341509+0000","last_unstale":"2024-09-17T04:11:51.217566+0000","last_undegraded":"2024-09-17T04:11:51.217566+0000","last_fullsized":"2024-09-17T04:11:51.217566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1193","last_scrub_stamp":"2024-09-17T04:11:51.217378+0000","last_deep_scrub":"29'1193","last_deep_scrub_stamp":"2024-09-17T04:11:51.217378+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.217378+0000","objects_scrubbed":4,"log_size":1193,"log_dups_size":0,"ondisk_log_size":1193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.400098+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":5144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.545937+0000","last_change":"2024-09-17T04:12:04.545851+0000","last_active":"2024-09-17T04:12:04.545937+0000","last_peered":"2024-09-17T04:12:04.545937+0000","last_clean":"2024-09-17T04:12:04.545937+0000","last_became_active":"2024-09-17T04:09:44.393322+0000","last_became_peered":"2024-09-17T04:09:44.393322+0000","last_unstale":"2024-09-17T04:12:04.545937+0000","last_undegraded":"2024-09-17T04:12:04.545937+0000","last_fullsized":"2024-09-17T04:12:04.545937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:04.545747+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:04.545747+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.545747+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:44.903938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.006269+0000","last_change":"2024-09-17T04:11:54.006154+0000","last_active":"2024-09-17T04:11:54.006269+0000","last_peered":"2024-09-17T04:11:54.006269+0000","last_clean":"2024-09-17T04:11:54.006269+0000","last_became_active":"2024-09-17T04:09:40.359298+0000","last_became_peered":"2024-09-17T04:09:40.359298+0000","last_unstale":"2024-09-17T04:11:54.006269+0000","last_undegraded":"2024-09-17T04:11:54.006269+0000","last_fullsized":"2024-09-17T04:11:54.006269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:54.006009+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:54.006009+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.006009+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:07.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'42","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.635392+0000","last_change":"2024-09-17T04:11:53.635319+0000","last_active":"2024-09-17T04:11:53.635392+0000","last_peered":"2024-09-17T04:11:53.635392+0000","last_clean":"2024-09-17T04:11:53.635392+0000","last_became_active":"2024-09-17T04:09:39.340849+0000","last_became_peered":"2024-09-17T04:09:39.340849+0000","last_unstale":"2024-09-17T04:11:53.635392+0000","last_undegraded":"2024-09-17T04:11:53.635392+0000","last_fullsized":"2024-09-17T04:11:53.635392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:53.635226+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:53.635226+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.635226+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:19.590957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'45","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.873520+0000","last_change":"2024-09-17T04:12:02.873447+0000","last_active":"2024-09-17T04:12:02.873520+0000","last_peered":"2024-09-17T04:12:02.873520+0000","last_clean":"2024-09-17T04:12:02.873520+0000","last_became_active":"2024-09-17T04:09:44.385884+0000","last_became_peered":"2024-09-17T04:09:44.385884+0000","last_unstale":"2024-09-17T04:12:02.873520+0000","last_undegraded":"2024-09-17T04:12:02.873520+0000","last_fullsized":"2024-09-17T04:12:02.873520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-09-17T04:12:02.873360+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-09-17T04:12:02.873360+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.873360+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:54.832082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'50","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.727227+0000","last_change":"2024-09-17T04:11:52.727108+0000","last_active":"2024-09-17T04:11:52.727227+0000","last_peered":"2024-09-17T04:11:52.727227+0000","last_clean":"2024-09-17T04:11:52.727227+0000","last_became_active":"2024-09-17T04:10:20.771652+0000","last_became_peered":"2024-09-17T04:10:20.771652+0000","last_unstale":"2024-09-17T04:11:52.727227+0000","last_undegraded":"2024-09-17T04:11:52.727227+0000","last_fullsized":"2024-09-17T04:11:52.727227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:52.726948+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:52.726948+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.726948+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:08.423760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'24","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.968756+0000","last_change":"2024-09-17T04:11:54.968651+0000","last_active":"2024-09-17T04:11:54.968756+0000","last_peered":"2024-09-17T04:11:54.968756+0000","last_clean":"2024-09-17T04:11:54.968756+0000","last_became_active":"2024-09-17T04:09:39.343723+0000","last_became_peered":"2024-09-17T04:09:39.343723+0000","last_unstale":"2024-09-17T04:11:54.968756+0000","last_undegraded":"2024-09-17T04:11:54.968756+0000","last_fullsized":"2024-09-17T04:11:54.968756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2024-09-17T04:11:54.968549+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2024-09-17T04:11:54.968549+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.968549+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:43.723762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'39","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.261367+0000","last_change":"2024-09-17T04:12:03.261280+0000","last_active":"2024-09-17T04:12:03.261367+0000","last_peered":"2024-09-17T04:12:03.261367+0000","last_clean":"2024-09-17T04:12:03.261367+0000","last_became_active":"2024-09-17T04:09:44.386614+0000","last_became_peered":"2024-09-17T04:09:44.386614+0000","last_unstale":"2024-09-17T04:12:03.261367+0000","last_undegraded":"2024-09-17T04:12:03.261367+0000","last_fullsized":"2024-09-17T04:12:03.261367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-09-17T04:12:03.261186+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-09-17T04:12:03.261186+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.261186+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:30.613630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'73","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.926015+0000","last_change":"2024-09-17T04:11:55.925949+0000","last_active":"2024-09-17T04:11:55.926015+0000","last_peered":"2024-09-17T04:11:55.926015+0000","last_clean":"2024-09-17T04:11:55.926015+0000","last_became_active":"2024-09-17T04:09:40.355323+0000","last_became_peered":"2024-09-17T04:09:40.355323+0000","last_unstale":"2024-09-17T04:11:55.926015+0000","last_undegraded":"2024-09-17T04:11:55.926015+0000","last_fullsized":"2024-09-17T04:11:55.926015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-09-17T04:11:55.925860+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-09-17T04:11:55.925860+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.925860+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:55.416256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'23","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:52.252779+0000","last_change":"2024-09-17T04:11:52.252660+0000","last_active":"2024-09-17T04:11:52.252779+0000","last_peered":"2024-09-17T04:11:52.252779+0000","last_clean":"2024-09-17T04:11:52.252779+0000","last_became_active":"2024-09-17T04:09:39.342079+0000","last_became_peered":"2024-09-17T04:09:39.342079+0000","last_unstale":"2024-09-17T04:11:52.252779+0000","last_undegraded":"2024-09-17T04:11:52.252779+0000","last_fullsized":"2024-09-17T04:11:52.252779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-09-17T04:11:52.252562+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-09-17T04:11:52.252562+0000","last_clean_scrub_stamp":"2024-09-17T04:11:52.252562+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:51.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'42","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.239058+0000","last_change":"2024-09-17T04:12:05.239058+0000","last_active":"2024-09-17T04:12:05.239058+0000","last_peered":"2024-09-17T04:12:05.239058+0000","last_clean":"2024-09-17T04:12:05.239058+0000","last_became_active":"2024-09-17T04:09:44.494996+0000","last_became_peered":"2024-09-17T04:09:44.494996+0000","last_unstale":"2024-09-17T04:12:05.239058+0000","last_undegraded":"2024-09-17T04:12:05.239058+0000","last_fullsized":"2024-09-17T04:12:05.239058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:12:05.238911+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:12:05.238911+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.238911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:06.839317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'43","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.594147+0000","last_change":"2024-09-17T04:12:03.594147+0000","last_active":"2024-09-17T04:12:03.594147+0000","last_peered":"2024-09-17T04:12:03.594147+0000","last_clean":"2024-09-17T04:12:03.594147+0000","last_became_active":"2024-09-17T04:09:44.490315+0000","last_became_peered":"2024-09-17T04:09:44.490315+0000","last_unstale":"2024-09-17T04:12:03.594147+0000","last_undegraded":"2024-09-17T04:12:03.594147+0000","last_fullsized":"2024-09-17T04:12:03.594147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:12:03.594053+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:12:03.594053+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.594053+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:54.774282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'54","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.546667+0000","last_change":"2024-09-17T04:12:01.546581+0000","last_active":"2024-09-17T04:12:01.546667+0000","last_peered":"2024-09-17T04:12:01.546667+0000","last_clean":"2024-09-17T04:12:01.546667+0000","last_became_active":"2024-09-17T04:09:40.349275+0000","last_became_peered":"2024-09-17T04:09:40.349275+0000","last_unstale":"2024-09-17T04:12:01.546667+0000","last_undegraded":"2024-09-17T04:12:01.546667+0000","last_fullsized":"2024-09-17T04:12:01.546667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:01.546499+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:01.546499+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.546499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:17.535930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'20","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.976553+0000","last_change":"2024-09-17T04:11:53.976442+0000","last_active":"2024-09-17T04:11:53.976553+0000","last_peered":"2024-09-17T04:11:53.976553+0000","last_clean":"2024-09-17T04:11:53.976553+0000","last_became_active":"2024-09-17T04:09:39.339084+0000","last_became_peered":"2024-09-17T04:09:39.339084+0000","last_unstale":"2024-09-17T04:11:53.976553+0000","last_undegraded":"2024-09-17T04:11:53.976553+0000","last_fullsized":"2024-09-17T04:11:53.976553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-09-17T04:11:53.976342+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-09-17T04:11:53.976342+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.976342+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:14.339361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'50","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.206877+0000","last_change":"2024-09-17T04:12:04.206877+0000","last_active":"2024-09-17T04:12:04.206877+0000","last_peered":"2024-09-17T04:12:04.206877+0000","last_clean":"2024-09-17T04:12:04.206877+0000","last_became_active":"2024-09-17T04:09:44.386728+0000","last_became_peered":"2024-09-17T04:09:44.386728+0000","last_unstale":"2024-09-17T04:12:04.206877+0000","last_undegraded":"2024-09-17T04:12:04.206877+0000","last_fullsized":"2024-09-17T04:12:04.206877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:04.206766+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:04.206766+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.206766+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:56.215874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'65","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.169728+0000","last_change":"2024-09-17T04:11:56.169643+0000","last_active":"2024-09-17T04:11:56.169728+0000","last_peered":"2024-09-17T04:11:56.169728+0000","last_clean":"2024-09-17T04:11:56.169728+0000","last_became_active":"2024-09-17T04:09:40.344439+0000","last_became_peered":"2024-09-17T04:09:40.344439+0000","last_unstale":"2024-09-17T04:11:56.169728+0000","last_undegraded":"2024-09-17T04:11:56.169728+0000","last_fullsized":"2024-09-17T04:11:56.169728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-09-17T04:11:56.169545+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-09-17T04:11:56.169545+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.169545+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.058175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'19","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:51.188632+0000","last_change":"2024-09-17T04:11:51.188540+0000","last_active":"2024-09-17T04:11:51.188632+0000","last_peered":"2024-09-17T04:11:51.188632+0000","last_clean":"2024-09-17T04:11:51.188632+0000","last_became_active":"2024-09-17T04:09:39.342185+0000","last_became_peered":"2024-09-17T04:09:39.342185+0000","last_unstale":"2024-09-17T04:11:51.188632+0000","last_undegraded":"2024-09-17T04:11:51.188632+0000","last_fullsized":"2024-09-17T04:11:51.188632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-09-17T04:11:51.188421+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-09-17T04:11:51.188421+0000","last_clean_scrub_stamp":"2024-09-17T04:11:51.188421+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:09.687105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'29","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.266113+0000","last_change":"2024-09-17T04:11:53.266042+0000","last_active":"2024-09-17T04:11:53.266113+0000","last_peered":"2024-09-17T04:11:53.266113+0000","last_clean":"2024-09-17T04:11:53.266113+0000","last_became_active":"2024-09-17T04:09:39.340732+0000","last_became_peered":"2024-09-17T04:09:39.340732+0000","last_unstale":"2024-09-17T04:11:53.266113+0000","last_undegraded":"2024-09-17T04:11:53.266113+0000","last_fullsized":"2024-09-17T04:11:53.266113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2024-09-17T04:11:53.265923+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2024-09-17T04:11:53.265923+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.265923+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:03.333430+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.673813+0000","last_change":"2024-09-17T04:11:59.673754+0000","last_active":"2024-09-17T04:11:59.673813+0000","last_peered":"2024-09-17T04:11:59.673813+0000","last_clean":"2024-09-17T04:11:59.673813+0000","last_became_active":"2024-09-17T04:09:40.340743+0000","last_became_peered":"2024-09-17T04:09:40.340743+0000","last_unstale":"2024-09-17T04:11:59.673813+0000","last_undegraded":"2024-09-17T04:11:59.673813+0000","last_fullsized":"2024-09-17T04:11:59.673813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:11:59.673671+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:11:59.673671+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.673671+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:03.918950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'36","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.840984+0000","last_change":"2024-09-17T04:11:57.840889+0000","last_active":"2024-09-17T04:11:57.840984+0000","last_peered":"2024-09-17T04:11:57.840984+0000","last_clean":"2024-09-17T04:11:57.840984+0000","last_became_active":"2024-09-17T04:10:20.524819+0000","last_became_peered":"2024-09-17T04:10:20.524819+0000","last_unstale":"2024-09-17T04:11:57.840984+0000","last_undegraded":"2024-09-17T04:11:57.840984+0000","last_fullsized":"2024-09-17T04:11:57.840984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-09-17T04:11:57.840789+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-09-17T04:11:57.840789+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.840789+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:00.859542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1500","reported_seq":1536,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.196735+0000","last_change":"2024-09-17T04:11:53.196614+0000","last_active":"2024-09-17T04:11:53.196735+0000","last_peered":"2024-09-17T04:11:53.196735+0000","last_clean":"2024-09-17T04:11:53.196735+0000","last_became_active":"2024-09-17T04:09:39.341779+0000","last_became_peered":"2024-09-17T04:09:39.341779+0000","last_unstale":"2024-09-17T04:11:53.196735+0000","last_undegraded":"2024-09-17T04:11:53.196735+0000","last_fullsized":"2024-09-17T04:11:53.196735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1500","last_scrub_stamp":"2024-09-17T04:11:53.196512+0000","last_deep_scrub":"29'1500","last_deep_scrub_stamp":"2024-09-17T04:11:53.196512+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.196512+0000","objects_scrubbed":1,"log_size":1500,"log_dups_size":0,"ondisk_log_size":1500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:49.272799+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1474,"num_write_kb":5370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'44","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:53.010405+0000","last_change":"2024-09-17T04:11:53.010341+0000","last_active":"2024-09-17T04:11:53.010405+0000","last_peered":"2024-09-17T04:11:53.010405+0000","last_clean":"2024-09-17T04:11:53.010405+0000","last_became_active":"2024-09-17T04:09:40.345822+0000","last_became_peered":"2024-09-17T04:09:40.345822+0000","last_unstale":"2024-09-17T04:11:53.010405+0000","last_undegraded":"2024-09-17T04:11:53.010405+0000","last_fullsized":"2024-09-17T04:11:53.010405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:11:53.010235+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:11:53.010235+0000","last_clean_scrub_stamp":"2024-09-17T04:11:53.010235+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:46.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'55","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:09.274660+0000","last_change":"2024-09-17T04:12:09.274546+0000","last_active":"2024-09-17T04:12:09.274660+0000","last_peered":"2024-09-17T04:12:09.274660+0000","last_clean":"2024-09-17T04:12:09.274660+0000","last_became_active":"2024-09-17T04:09:44.387717+0000","last_became_peered":"2024-09-17T04:09:44.387717+0000","last_unstale":"2024-09-17T04:12:09.274660+0000","last_undegraded":"2024-09-17T04:12:09.274660+0000","last_fullsized":"2024-09-17T04:12:09.274660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:09.274393+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:09.274393+0000","last_clean_scrub_stamp":"2024-09-17T04:12:09.274393+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:56.620620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'69","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.145925+0000","last_change":"2024-09-17T04:11:58.145925+0000","last_active":"2024-09-17T04:11:58.145925+0000","last_peered":"2024-09-17T04:11:58.145925+0000","last_clean":"2024-09-17T04:11:58.145925+0000","last_became_active":"2024-09-17T04:09:40.360679+0000","last_became_peered":"2024-09-17T04:09:40.360679+0000","last_unstale":"2024-09-17T04:11:58.145925+0000","last_undegraded":"2024-09-17T04:11:58.145925+0000","last_fullsized":"2024-09-17T04:11:58.145925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'69","last_scrub_stamp":"2024-09-17T04:11:58.145837+0000","last_deep_scrub":"29'69","last_deep_scrub_stamp":"2024-09-17T04:11:58.145837+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.145837+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:01.980709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'59","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:49.855734+0000","last_change":"2024-09-17T04:11:49.855734+0000","last_active":"2024-09-17T04:11:49.855734+0000","last_peered":"2024-09-17T04:11:49.855734+0000","last_clean":"2024-09-17T04:11:49.855734+0000","last_became_active":"2024-09-17T04:09:40.340651+0000","last_became_peered":"2024-09-17T04:09:40.340651+0000","last_unstale":"2024-09-17T04:11:49.855734+0000","last_undegraded":"2024-09-17T04:11:49.855734+0000","last_fullsized":"2024-09-17T04:11:49.855734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2024-09-17T04:11:49.855663+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2024-09-17T04:11:49.855663+0000","last_clean_scrub_stamp":"2024-09-17T04:11:49.855663+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.176436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.938829+0000","last_change":"2024-09-17T04:12:00.938829+0000","last_active":"2024-09-17T04:12:00.938829+0000","last_peered":"2024-09-17T04:12:00.938829+0000","last_clean":"2024-09-17T04:12:00.938829+0000","last_became_active":"2024-09-17T04:09:40.352606+0000","last_became_peered":"2024-09-17T04:09:40.352606+0000","last_unstale":"2024-09-17T04:12:00.938829+0000","last_undegraded":"2024-09-17T04:12:00.938829+0000","last_fullsized":"2024-09-17T04:12:00.938829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:12:00.938719+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:12:00.938719+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.938719+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:28.574921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'52","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.696830+0000","last_change":"2024-09-17T04:11:57.696830+0000","last_active":"2024-09-17T04:11:57.696830+0000","last_peered":"2024-09-17T04:11:57.696830+0000","last_clean":"2024-09-17T04:11:57.696830+0000","last_became_active":"2024-09-17T04:09:40.349017+0000","last_became_peered":"2024-09-17T04:09:40.349017+0000","last_unstale":"2024-09-17T04:11:57.696830+0000","last_undegraded":"2024-09-17T04:11:57.696830+0000","last_fullsized":"2024-09-17T04:11:57.696830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2024-09-17T04:11:57.696736+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2024-09-17T04:11:57.696736+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.696736+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:27.523124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'50","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:58.266358+0000","last_change":"2024-09-17T04:11:58.266358+0000","last_active":"2024-09-17T04:11:58.266358+0000","last_peered":"2024-09-17T04:11:58.266358+0000","last_clean":"2024-09-17T04:11:58.266358+0000","last_became_active":"2024-09-17T04:09:40.357958+0000","last_became_peered":"2024-09-17T04:09:40.357958+0000","last_unstale":"2024-09-17T04:11:58.266358+0000","last_undegraded":"2024-09-17T04:11:58.266358+0000","last_fullsized":"2024-09-17T04:11:58.266358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:11:58.266238+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:11:58.266238+0000","last_clean_scrub_stamp":"2024-09-17T04:11:58.266238+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:12.258250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'37","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.642547+0000","last_change":"2024-09-17T04:11:56.642547+0000","last_active":"2024-09-17T04:11:56.642547+0000","last_peered":"2024-09-17T04:11:56.642547+0000","last_clean":"2024-09-17T04:11:56.642547+0000","last_became_active":"2024-09-17T04:09:40.354542+0000","last_became_peered":"2024-09-17T04:09:40.354542+0000","last_unstale":"2024-09-17T04:11:56.642547+0000","last_undegraded":"2024-09-17T04:11:56.642547+0000","last_fullsized":"2024-09-17T04:11:56.642547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-09-17T04:11:56.642459+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-09-17T04:11:56.642459+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.642459+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:30.552630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'66","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.127830+0000","last_change":"2024-09-17T04:11:59.127830+0000","last_active":"2024-09-17T04:11:59.127830+0000","last_peered":"2024-09-17T04:11:59.127830+0000","last_clean":"2024-09-17T04:11:59.127830+0000","last_became_active":"2024-09-17T04:09:40.359971+0000","last_became_peered":"2024-09-17T04:09:40.359971+0000","last_unstale":"2024-09-17T04:11:59.127830+0000","last_undegraded":"2024-09-17T04:11:59.127830+0000","last_fullsized":"2024-09-17T04:11:59.127830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-09-17T04:11:59.127734+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-09-17T04:11:59.127734+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.127734+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:21.046705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'42","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.236816+0000","last_change":"2024-09-17T04:11:59.236816+0000","last_active":"2024-09-17T04:11:59.236816+0000","last_peered":"2024-09-17T04:11:59.236816+0000","last_clean":"2024-09-17T04:11:59.236816+0000","last_became_active":"2024-09-17T04:09:40.357555+0000","last_became_peered":"2024-09-17T04:09:40.357555+0000","last_unstale":"2024-09-17T04:11:59.236816+0000","last_undegraded":"2024-09-17T04:11:59.236816+0000","last_fullsized":"2024-09-17T04:11:59.236816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-09-17T04:11:59.236720+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-09-17T04:11:59.236720+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.236720+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:44.523201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'49","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.950597+0000","last_change":"2024-09-17T04:11:59.950597+0000","last_active":"2024-09-17T04:11:59.950597+0000","last_peered":"2024-09-17T04:11:59.950597+0000","last_clean":"2024-09-17T04:11:59.950597+0000","last_became_active":"2024-09-17T04:09:40.351305+0000","last_became_peered":"2024-09-17T04:09:40.351305+0000","last_unstale":"2024-09-17T04:11:59.950597+0000","last_undegraded":"2024-09-17T04:11:59.950597+0000","last_fullsized":"2024-09-17T04:11:59.950597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-09-17T04:11:59.950487+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-09-17T04:11:59.950487+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.950487+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:14.213032+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.272997+0000","last_change":"2024-09-17T04:12:01.272997+0000","last_active":"2024-09-17T04:12:01.272997+0000","last_peered":"2024-09-17T04:12:01.272997+0000","last_clean":"2024-09-17T04:12:01.272997+0000","last_became_active":"2024-09-17T04:09:40.357497+0000","last_became_peered":"2024-09-17T04:09:40.357497+0000","last_unstale":"2024-09-17T04:12:01.272997+0000","last_undegraded":"2024-09-17T04:12:01.272997+0000","last_fullsized":"2024-09-17T04:12:01.272997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:01.272882+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:01.272882+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.272882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:22.712837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.985702+0000","last_change":"2024-09-17T04:12:02.985702+0000","last_active":"2024-09-17T04:12:02.985702+0000","last_peered":"2024-09-17T04:12:02.985702+0000","last_clean":"2024-09-17T04:12:02.985702+0000","last_became_active":"2024-09-17T04:09:40.355720+0000","last_became_peered":"2024-09-17T04:09:40.355720+0000","last_unstale":"2024-09-17T04:12:02.985702+0000","last_undegraded":"2024-09-17T04:12:02.985702+0000","last_fullsized":"2024-09-17T04:12:02.985702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:12:02.985581+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:12:02.985581+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.985581+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:46.220816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'63","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.625030+0000","last_change":"2024-09-17T04:12:00.625030+0000","last_active":"2024-09-17T04:12:00.625030+0000","last_peered":"2024-09-17T04:12:00.625030+0000","last_clean":"2024-09-17T04:12:00.625030+0000","last_became_active":"2024-09-17T04:09:40.359431+0000","last_became_peered":"2024-09-17T04:09:40.359431+0000","last_unstale":"2024-09-17T04:12:00.625030+0000","last_undegraded":"2024-09-17T04:12:00.625030+0000","last_fullsized":"2024-09-17T04:12:00.625030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-09-17T04:12:00.624912+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-09-17T04:12:00.624912+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.624912+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:52.060207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'62","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.134271+0000","last_change":"2024-09-17T04:12:00.134271+0000","last_active":"2024-09-17T04:12:00.134271+0000","last_peered":"2024-09-17T04:12:00.134271+0000","last_clean":"2024-09-17T04:12:00.134271+0000","last_became_active":"2024-09-17T04:09:40.354428+0000","last_became_peered":"2024-09-17T04:09:40.354428+0000","last_unstale":"2024-09-17T04:12:00.134271+0000","last_undegraded":"2024-09-17T04:12:00.134271+0000","last_fullsized":"2024-09-17T04:12:00.134271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'62","last_scrub_stamp":"2024-09-17T04:12:00.134127+0000","last_deep_scrub":"29'62","last_deep_scrub_stamp":"2024-09-17T04:12:00.134127+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.134127+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:20.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.718337+0000","last_change":"2024-09-17T04:12:04.718337+0000","last_active":"2024-09-17T04:12:04.718337+0000","last_peered":"2024-09-17T04:12:04.718337+0000","last_clean":"2024-09-17T04:12:04.718337+0000","last_became_active":"2024-09-17T04:09:40.358709+0000","last_became_peered":"2024-09-17T04:09:40.358709+0000","last_unstale":"2024-09-17T04:12:04.718337+0000","last_undegraded":"2024-09-17T04:12:04.718337+0000","last_fullsized":"2024-09-17T04:12:04.718337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:04.718244+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:04.718244+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.718244+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:10.748177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'58","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:55.885280+0000","last_change":"2024-09-17T04:11:55.885209+0000","last_active":"2024-09-17T04:11:55.885280+0000","last_peered":"2024-09-17T04:11:55.885280+0000","last_clean":"2024-09-17T04:11:55.885280+0000","last_became_active":"2024-09-17T04:09:40.355176+0000","last_became_peered":"2024-09-17T04:09:40.355176+0000","last_unstale":"2024-09-17T04:11:55.885280+0000","last_undegraded":"2024-09-17T04:11:55.885280+0000","last_fullsized":"2024-09-17T04:11:55.885280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'58","last_scrub_stamp":"2024-09-17T04:11:55.885119+0000","last_deep_scrub":"29'58","last_deep_scrub_stamp":"2024-09-17T04:11:55.885119+0000","last_clean_scrub_stamp":"2024-09-17T04:11:55.885119+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:02.262847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'55","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.847135+0000","last_change":"2024-09-17T04:11:56.847135+0000","last_active":"2024-09-17T04:11:56.847135+0000","last_peered":"2024-09-17T04:11:56.847135+0000","last_clean":"2024-09-17T04:11:56.847135+0000","last_became_active":"2024-09-17T04:10:20.774639+0000","last_became_peered":"2024-09-17T04:10:20.774639+0000","last_unstale":"2024-09-17T04:11:56.847135+0000","last_undegraded":"2024-09-17T04:11:56.847135+0000","last_fullsized":"2024-09-17T04:11:56.847135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:56.847047+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:56.847047+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.847047+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:49.684836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.956619+0000","last_change":"2024-09-17T04:12:01.956548+0000","last_active":"2024-09-17T04:12:01.956619+0000","last_peered":"2024-09-17T04:12:01.956619+0000","last_clean":"2024-09-17T04:12:01.956619+0000","last_became_active":"2024-09-17T04:09:40.345957+0000","last_became_peered":"2024-09-17T04:09:40.345957+0000","last_unstale":"2024-09-17T04:12:01.956619+0000","last_undegraded":"2024-09-17T04:12:01.956619+0000","last_fullsized":"2024-09-17T04:12:01.956619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:01.956464+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:01.956464+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.956464+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:29.695752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'53","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:57.604842+0000","last_change":"2024-09-17T04:11:57.604746+0000","last_active":"2024-09-17T04:11:57.604842+0000","last_peered":"2024-09-17T04:11:57.604842+0000","last_clean":"2024-09-17T04:11:57.604842+0000","last_became_active":"2024-09-17T04:09:40.342415+0000","last_became_peered":"2024-09-17T04:09:40.342415+0000","last_unstale":"2024-09-17T04:11:57.604842+0000","last_undegraded":"2024-09-17T04:11:57.604842+0000","last_fullsized":"2024-09-17T04:11:57.604842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2024-09-17T04:11:57.604603+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2024-09-17T04:11:57.604603+0000","last_clean_scrub_stamp":"2024-09-17T04:11:57.604603+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:40.352951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'59","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:56.704555+0000","last_change":"2024-09-17T04:11:56.704494+0000","last_active":"2024-09-17T04:11:56.704555+0000","last_peered":"2024-09-17T04:11:56.704555+0000","last_clean":"2024-09-17T04:11:56.704555+0000","last_became_active":"2024-09-17T04:09:40.343621+0000","last_became_peered":"2024-09-17T04:09:40.343621+0000","last_unstale":"2024-09-17T04:11:56.704555+0000","last_undegraded":"2024-09-17T04:11:56.704555+0000","last_fullsized":"2024-09-17T04:11:56.704555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2024-09-17T04:11:56.704401+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2024-09-17T04:11:56.704401+0000","last_clean_scrub_stamp":"2024-09-17T04:11:56.704401+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:56.194797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:00.267172+0000","last_change":"2024-09-17T04:12:00.267100+0000","last_active":"2024-09-17T04:12:00.267172+0000","last_peered":"2024-09-17T04:12:00.267172+0000","last_clean":"2024-09-17T04:12:00.267172+0000","last_became_active":"2024-09-17T04:09:40.354670+0000","last_became_peered":"2024-09-17T04:09:40.354670+0000","last_unstale":"2024-09-17T04:12:00.267172+0000","last_undegraded":"2024-09-17T04:12:00.267172+0000","last_fullsized":"2024-09-17T04:12:00.267172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:12:00.267014+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:12:00.267014+0000","last_clean_scrub_stamp":"2024-09-17T04:12:00.267014+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:11.160179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'44","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.968902+0000","last_change":"2024-09-17T04:11:54.968792+0000","last_active":"2024-09-17T04:11:54.968902+0000","last_peered":"2024-09-17T04:11:54.968902+0000","last_clean":"2024-09-17T04:11:54.968902+0000","last_became_active":"2024-09-17T04:09:40.353274+0000","last_became_peered":"2024-09-17T04:09:40.353274+0000","last_unstale":"2024-09-17T04:11:54.968902+0000","last_undegraded":"2024-09-17T04:11:54.968902+0000","last_fullsized":"2024-09-17T04:11:54.968902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-09-17T04:11:54.968643+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-09-17T04:11:54.968643+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.968643+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:25.018394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'50","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:01.148577+0000","last_change":"2024-09-17T04:12:01.148510+0000","last_active":"2024-09-17T04:12:01.148577+0000","last_peered":"2024-09-17T04:12:01.148577+0000","last_clean":"2024-09-17T04:12:01.148577+0000","last_became_active":"2024-09-17T04:09:40.353236+0000","last_became_peered":"2024-09-17T04:09:40.353236+0000","last_unstale":"2024-09-17T04:12:01.148577+0000","last_undegraded":"2024-09-17T04:12:01.148577+0000","last_fullsized":"2024-09-17T04:12:01.148577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2024-09-17T04:12:01.148412+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2024-09-17T04:12:01.148412+0000","last_clean_scrub_stamp":"2024-09-17T04:12:01.148412+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:49.903624+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'53","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.152318+0000","last_change":"2024-09-17T04:12:02.152251+0000","last_active":"2024-09-17T04:12:02.152318+0000","last_peered":"2024-09-17T04:12:02.152318+0000","last_clean":"2024-09-17T04:12:02.152318+0000","last_became_active":"2024-09-17T04:09:40.352325+0000","last_became_peered":"2024-09-17T04:09:40.352325+0000","last_unstale":"2024-09-17T04:12:02.152318+0000","last_undegraded":"2024-09-17T04:12:02.152318+0000","last_fullsized":"2024-09-17T04:12:02.152318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2024-09-17T04:12:02.152143+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2024-09-17T04:12:02.152143+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.152143+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:01.642539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'54","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:05.717134+0000","last_change":"2024-09-17T04:12:05.717061+0000","last_active":"2024-09-17T04:12:05.717134+0000","last_peered":"2024-09-17T04:12:05.717134+0000","last_clean":"2024-09-17T04:12:05.717134+0000","last_became_active":"2024-09-17T04:09:40.364574+0000","last_became_peered":"2024-09-17T04:09:40.364574+0000","last_unstale":"2024-09-17T04:12:05.717134+0000","last_undegraded":"2024-09-17T04:12:05.717134+0000","last_fullsized":"2024-09-17T04:12:05.717134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:05.716954+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:05.716954+0000","last_clean_scrub_stamp":"2024-09-17T04:12:05.716954+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:52.921183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:02.242292+0000","last_change":"2024-09-17T04:12:02.242173+0000","last_active":"2024-09-17T04:12:02.242292+0000","last_peered":"2024-09-17T04:12:02.242292+0000","last_clean":"2024-09-17T04:12:02.242292+0000","last_became_active":"2024-09-17T04:09:40.352332+0000","last_became_peered":"2024-09-17T04:09:40.352332+0000","last_unstale":"2024-09-17T04:12:02.242292+0000","last_undegraded":"2024-09-17T04:12:02.242292+0000","last_fullsized":"2024-09-17T04:12:02.242292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:02.242039+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:02.242039+0000","last_clean_scrub_stamp":"2024-09-17T04:12:02.242039+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:06.456955+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'54","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:06.695346+0000","last_change":"2024-09-17T04:12:06.695261+0000","last_active":"2024-09-17T04:12:06.695346+0000","last_peered":"2024-09-17T04:12:06.695346+0000","last_clean":"2024-09-17T04:12:06.695346+0000","last_became_active":"2024-09-17T04:09:40.359578+0000","last_became_peered":"2024-09-17T04:09:40.359578+0000","last_unstale":"2024-09-17T04:12:06.695346+0000","last_undegraded":"2024-09-17T04:12:06.695346+0000","last_fullsized":"2024-09-17T04:12:06.695346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'54","last_scrub_stamp":"2024-09-17T04:12:06.695151+0000","last_deep_scrub":"29'54","last_deep_scrub_stamp":"2024-09-17T04:12:06.695151+0000","last_clean_scrub_stamp":"2024-09-17T04:12:06.695151+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:49.930386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'51","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:03.987575+0000","last_change":"2024-09-17T04:12:03.987457+0000","last_active":"2024-09-17T04:12:03.987575+0000","last_peered":"2024-09-17T04:12:03.987575+0000","last_clean":"2024-09-17T04:12:03.987575+0000","last_became_active":"2024-09-17T04:09:40.344372+0000","last_became_peered":"2024-09-17T04:09:40.344372+0000","last_unstale":"2024-09-17T04:12:03.987575+0000","last_undegraded":"2024-09-17T04:12:03.987575+0000","last_fullsized":"2024-09-17T04:12:03.987575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-09-17T04:12:03.987348+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-09-17T04:12:03.987348+0000","last_clean_scrub_stamp":"2024-09-17T04:12:03.987348+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:03.180468+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:08.752162+0000","last_change":"2024-09-17T04:12:08.752096+0000","last_active":"2024-09-17T04:12:08.752162+0000","last_peered":"2024-09-17T04:12:08.752162+0000","last_clean":"2024-09-17T04:12:08.752162+0000","last_became_active":"2024-09-17T04:09:40.358941+0000","last_became_peered":"2024-09-17T04:09:40.358941+0000","last_unstale":"2024-09-17T04:12:08.752162+0000","last_undegraded":"2024-09-17T04:12:08.752162+0000","last_fullsized":"2024-09-17T04:12:08.752162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:12:08.752002+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:12:08.752002+0000","last_clean_scrub_stamp":"2024-09-17T04:12:08.752002+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:11.780014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'40","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:04.983661+0000","last_change":"2024-09-17T04:12:04.983661+0000","last_active":"2024-09-17T04:12:04.983661+0000","last_peered":"2024-09-17T04:12:04.983661+0000","last_clean":"2024-09-17T04:12:04.983661+0000","last_became_active":"2024-09-17T04:09:40.354564+0000","last_became_peered":"2024-09-17T04:09:40.354564+0000","last_unstale":"2024-09-17T04:12:04.983661+0000","last_undegraded":"2024-09-17T04:12:04.983661+0000","last_fullsized":"2024-09-17T04:12:04.983661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-09-17T04:12:04.983566+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-09-17T04:12:04.983566+0000","last_clean_scrub_stamp":"2024-09-17T04:12:04.983566+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:08.011578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'55","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:54.734916+0000","last_change":"2024-09-17T04:11:54.734916+0000","last_active":"2024-09-17T04:11:54.734916+0000","last_peered":"2024-09-17T04:11:54.734916+0000","last_clean":"2024-09-17T04:11:54.734916+0000","last_became_active":"2024-09-17T04:09:40.346272+0000","last_became_peered":"2024-09-17T04:09:40.346272+0000","last_unstale":"2024-09-17T04:11:54.734916+0000","last_undegraded":"2024-09-17T04:11:54.734916+0000","last_fullsized":"2024-09-17T04:11:54.734916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'55","last_scrub_stamp":"2024-09-17T04:11:54.734823+0000","last_deep_scrub":"29'55","last_deep_scrub_stamp":"2024-09-17T04:11:54.734823+0000","last_clean_scrub_stamp":"2024-09-17T04:11:54.734823+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:47.686457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'43","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:11:59.595321+0000","last_change":"2024-09-17T04:11:59.595321+0000","last_active":"2024-09-17T04:11:59.595321+0000","last_peered":"2024-09-17T04:11:59.595321+0000","last_clean":"2024-09-17T04:11:59.595321+0000","last_became_active":"2024-09-17T04:09:40.347626+0000","last_became_peered":"2024-09-17T04:09:40.347626+0000","last_unstale":"2024-09-17T04:11:59.595321+0000","last_undegraded":"2024-09-17T04:11:59.595321+0000","last_fullsized":"2024-09-17T04:11:59.595321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2024-09-17T04:11:59.595223+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2024-09-17T04:11:59.595223+0000","last_clean_scrub_stamp":"2024-09-17T04:11:59.595223+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:24.999352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T04:12:07.721941+0000","last_change":"2024-09-17T04:12:07.721941+0000","last_active":"2024-09-17T04:12:07.721941+0000","last_peered":"2024-09-17T04:12:07.721941+0000","last_clean":"2024-09-17T04:12:07.721941+0000","last_became_active":"2024-09-17T04:09:40.362383+0000","last_became_peered":"2024-09-17T04:09:40.362383+0000","last_unstale":"2024-09-17T04:12:07.721941+0000","last_undegraded":"2024-09-17T04:12:07.721941+0000","last_fullsized":"2024-09-17T04:12:07.721941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-09-17T04:12:07.721844+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-09-17T04:12:07.721844+0000","last_clean_scrub_stamp":"2024-09-17T04:12:07.721844+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:06.914965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30916026,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":27,"num_read_kb":379,"num_write":3055,"num_write_kb":32947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61890560,"data_stored":61832052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57932,"kb_used_data":18428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313908,"statfs":{"total":96636764160,"available":96577441792,"internally_reserved":0,"allocated":18870272,"data_stored":18679561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49100,"kb_used_data":13756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322740,"statfs":{"total":96636764160,"available":96586485760,"internally_reserved":0,"allocated":14086144,"data_stored":13894979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":125550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39688,"kb_used_data":8504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332152,"statfs":{"total":96636764160,"available":96596123648,"internally_reserved":0,"allocated":8708096,"data_stored":8514194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74668,"kb_used_data":12956,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94297172,"statfs":{"total":96636764160,"available":96560304128,"internally_reserved":0,"allocated":13266944,"data_stored":13077537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":493953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40268,"kb_used_data":9084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331572,"statfs":{"total":96636764160,"available":96595529728,"internally_reserved":0,"allocated":9302016,"data_stored":9105074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":125620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13778944,"data_stored":13769519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17969152,"data_stored":17963733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:12:32.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T04:12:32.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 -- 172.21.15.104:0/1446113533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbce8005300 msgr2=0x7fbce800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1446113533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbce8005300 0x7fbce800b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001e90 tx=0x7fbce8005830 comp rx=0 tx=0).stop 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 -- 172.21.15.104:0/1446113533 shutdown_connections 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1446113533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbce8005300 0x7fbce800b9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 -- 172.21.15.104:0/1446113533 >> 172.21.15.104:0/1446113533 conn(0x7fbd0009d830 msgr2=0x7fbd000b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 -- 172.21.15.104:0/1446113533 shutdown_connections 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.268+0000 7fbd05cde640 1 -- 172.21.15.104:0/1446113533 wait complete. 2024-09-17T04:12:32.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.270+0000 7fbd05cde640 1 Processor -- start 2024-09-17T04:12:32.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.270+0000 7fbd05cde640 1 -- start start 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8005300 0x7fbd0006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd00159ad0 0x7fbd0006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cf120 con 0x7fbd0006f910 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cefa0 con 0x7fbce8005300 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbd05cde640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000cf2a0 con 0x7fbd00159ad0 2024-09-17T04:12:32.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41464/0 (socket says 172.21.15.104:41464) 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 -- 172.21.15.104:0/1501054530 learned_addr learned my addr 172.21.15.104:0/1501054530 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcff7fe640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8005300 0x7fbd0006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfffff640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd00159ad0 0x7fbd0006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 -- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd00159ad0 msgr2=0x7fbd0006e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd00159ad0 0x7fbd0006e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 -- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8005300 msgr2=0x7fbd0006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8005300 0x7fbd0006f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.271+0000 7fbcfeffd640 1 -- 172.21.15.104:0/1501054530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd001f63c0 con 0x7fbd0006f910 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbcfeffd640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400e570 tx=0x7fbcf400ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4015020 con 0x7fbd0006f910 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf4010980 con 0x7fbd0006f910 2024-09-17T04:12:32.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0015a2e0 con 0x7fbd0006f910 2024-09-17T04:12:32.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4010d90 con 0x7fbd0006f910 2024-09-17T04:12:32.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.272+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd001f58e0 con 0x7fbd0006f910 2024-09-17T04:12:32.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.273+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd000d0c30 con 0x7fbd0006f910 2024-09-17T04:12:32.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.274+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcf4018020 con 0x7fbd0006f910 2024-09-17T04:12:32.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.274+0000 7fbce7fff640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 0x7fbcec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.274+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbcf409b420 con 0x7fbd0006f910 2024-09-17T04:12:32.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.274+0000 7fbcff7fe640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 0x7fbcec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.275+0000 7fbcff7fe640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 0x7fbcec07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009a30 tx=0x7fbcf0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.279+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcf401f030 con 0x7fbd0006f910 2024-09-17T04:12:32.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.455+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbd000b5c70 con 0x7fbd0006f910 2024-09-17T04:12:32.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.459+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7fbd001592d0 con 0x7fbd0006f910 2024-09-17T04:12:32.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.461+0000 7fbce7fff640 1 -- 172.21.15.104:0/1501054530 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbcf4062900 con 0x7fbd0006f910 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 msgr2=0x7fbcec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 0x7fbcec07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009a30 tx=0x7fbcf0005f90 comp rx=0 tx=0).stop 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 msgr2=0x7fbd00159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400e570 tx=0x7fbcf400ea30 comp rx=0 tx=0).stop 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 shutdown_connections 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbcec078bc0 0x7fbcec07b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbd00159ad0 0x7fbd0006e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd0006f910 0x7fbd00159590 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 --2- 172.21.15.104:0/1501054530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8005300 0x7fbd0006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 >> 172.21.15.104:0/1501054530 conn(0x7fbd0009d830 msgr2=0x7fbd000b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 shutdown_connections 2024-09-17T04:12:32.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.462+0000 7fbd05cde640 1 -- 172.21.15.104:0/1501054530 wait complete. 2024-09-17T04:12:32.473 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T04:12:32.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:12:32.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 -- 172.21.15.104:0/3128942049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce44003a00 msgr2=0x7fce44003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 --2- 172.21.15.104:0/3128942049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce44003a00 0x7fce44003e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c290 tx=0x7fce44005830 comp rx=0 tx=0).stop 2024-09-17T04:12:32.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 -- 172.21.15.104:0/3128942049 shutdown_connections 2024-09-17T04:12:32.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 --2- 172.21.15.104:0/3128942049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce44003a00 0x7fce44003e50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 -- 172.21.15.104:0/3128942049 >> 172.21.15.104:0/3128942049 conn(0x7fce5c0b6b20 msgr2=0x7fce5c0d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 -- 172.21.15.104:0/3128942049 shutdown_connections 2024-09-17T04:12:32.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.588+0000 7fce626f2640 1 -- 172.21.15.104:0/3128942049 wait complete. 2024-09-17T04:12:32.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.590+0000 7fce626f2640 1 Processor -- start 2024-09-17T04:12:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.590+0000 7fce626f2640 1 -- start start 2024-09-17T04:12:32.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce44003a00 0x7fce5c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5c0b7e90 0x7fce5c1f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c0d24d0 con 0x7fce5c1f4c00 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c15fb90 con 0x7fce44003a00 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce626f2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c0d2650 con 0x7fce5c0b7e90 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce60c8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce60c8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41490/0 (socket says 172.21.15.104:41490) 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.591+0000 7fce60c8f640 1 -- 172.21.15.104:0/1024336080 learned_addr learned my addr 172.21.15.104:0/1024336080 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce5b7fe640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5c0b7e90 0x7fce5c1f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce5bfff640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce44003a00 0x7fce5c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 -- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5c0b7e90 msgr2=0x7fce5c1f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5c0b7e90 0x7fce5c1f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 -- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce44003a00 msgr2=0x7fce5c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce44003a00 0x7fce5c0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 -- 172.21.15.104:0/1024336080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c1f5230 con 0x7fce5c1f4c00 2024-09-17T04:12:32.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce60c8f640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fce54005fd0 tx=0x7fce54009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54004b20 con 0x7fce5c1f4c00 2024-09-17T04:12:32.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fce54004dd0 con 0x7fce5c1f4c00 2024-09-17T04:12:32.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c1f5510 con 0x7fce5c1f4c00 2024-09-17T04:12:32.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400fa30 con 0x7fce5c1f4c00 2024-09-17T04:12:32.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.592+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c1f5ad0 con 0x7fce5c1f4c00 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.593+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c1627c0 con 0x7fce5c1f4c00 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.594+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce5401b020 con 0x7fce5c1f4c00 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.595+0000 7fce58ff9640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.595+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fce5409b250 con 0x7fce5c1f4c00 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.595+0000 7fce5bfff640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.596+0000 7fce5bfff640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce4c033000 tx=0x7fce5c0d2ff0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.599+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce54063290 con 0x7fce5c1f4c00 2024-09-17T04:12:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.806+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce5c0b82a0 con 0x7fce5c1f4c00 2024-09-17T04:12:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.807+0000 7fce58ff9640 1 -- 172.21.15.104:0/1024336080 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fce54062b90 con 0x7fce5c1f4c00 2024-09-17T04:12:32.807 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:12:32.807 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:12:32.807 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:12:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 msgr2=0x7fce4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce4c033000 tx=0x7fce5c0d2ff0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 msgr2=0x7fce5c0aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fce54005fd0 tx=0x7fce54009b00 comp rx=0 tx=0).stop 2024-09-17T04:12:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 shutdown_connections 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5c1f4c00 0x7fce5c0aadc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5c0b7e90 0x7fce5c1f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 --2- 172.21.15.104:0/1024336080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce44003a00 0x7fce5c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 >> 172.21.15.104:0/1024336080 conn(0x7fce5c0b6b20 msgr2=0x7fce5c0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 shutdown_connections 2024-09-17T04:12:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.809+0000 7fce626f2640 1 -- 172.21.15.104:0/1024336080 wait complete. 2024-09-17T04:12:32.820 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:12:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 -- 172.21.15.104:0/1838532494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1380d0b40 msgr2=0x7fe13806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/1838532494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1380d0b40 0x7fe13806e6f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe134005fd0 tx=0x7fe13402a8a0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 -- 172.21.15.104:0/1838532494 shutdown_connections 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/1838532494 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe138073d50 0x7fe138074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/1838532494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1380d0b40 0x7fe13806e6f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 -- 172.21.15.104:0/1838532494 >> 172.21.15.104:0/1838532494 conn(0x7fe1380b2cc0 msgr2=0x7fe1380b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 -- 172.21.15.104:0/1838532494 shutdown_connections 2024-09-17T04:12:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.932+0000 7fe13f9f1640 1 -- 172.21.15.104:0/1838532494 wait complete. 2024-09-17T04:12:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.934+0000 7fe13f9f1640 1 Processor -- start 2024-09-17T04:12:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.934+0000 7fe13f9f1640 1 -- start start 2024-09-17T04:12:32.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.935+0000 7fe13f9f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.935+0000 7fe13f9f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe138073d50 0x7fe1381f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.935+0000 7fe13f9f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1380d0b40 0x7fe1381f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13f9f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815b960 con 0x7fe13806ec30 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13f9f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815b7e0 con 0x7fe1380d0b40 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13f9f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe13815bae0 con 0x7fe138073d50 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41506/0 (socket says 172.21.15.104:41506) 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 -- 172.21.15.104:0/4163658927 learned_addr learned my addr 172.21.15.104:0/4163658927 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 -- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe138073d50 msgr2=0x7fe1381f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe138073d50 0x7fe1381f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 -- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1380d0b40 msgr2=0x7fe1381f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1380d0b40 0x7fe1381f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 -- 172.21.15.104:0/4163658927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1381f3480 con 0x7fe13806ec30 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13d78d640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe134000f80 tx=0x7fe134032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134041070 con 0x7fe13806ec30 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fe1340045a0 con 0x7fe13806ec30 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1381f3740 con 0x7fe13806ec30 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.936+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13403b440 con 0x7fe13806ec30 2024-09-17T04:12:32.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.937+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1381f3d00 con 0x7fe13806ec30 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.937+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13815c050 con 0x7fe13806ec30 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.938+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe134044070 con 0x7fe13806ec30 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.939+0000 7fe12dffb640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 0x7fe11c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.939+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fe13402e020 con 0x7fe13806ec30 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.939+0000 7fe13cf8c640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 0x7fe11c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:32.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.940+0000 7fe13cf8c640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 0x7fe11c07b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe128000f60 tx=0x7fe128007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:32.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:32.943+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe13404b070 con 0x7fe13806ec30 2024-09-17T04:12:33.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.150+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe138074370 con 0x7fe13806ec30 2024-09-17T04:12:33.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.151+0000 7fe12dffb640 1 -- 172.21.15.104:0/4163658927 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fe1340840b0 con 0x7fe13806ec30 2024-09-17T04:12:33.151 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:12:33.151 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":9,"btime":"2024-09-17T04:09:53:405758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1242300967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1242300967},{"type":"v1","addr":"172.21.15.192:6836","nonce":1242300967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4413,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/4241618269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":4241618269},{"type":"v1","addr":"172.21.15.104:6834","nonce":4241618269}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4416,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1664066910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1664066910},{"type":"v1","addr":"172.21.15.104:6835","nonce":1664066910}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:09:39.684542+0000","modified":"2024-09-17T04:09:52.757484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/4000193285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4000193285},{"type":"v1","addr":"172.21.15.192:6837","nonce":4000193285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T04:12:33.151 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 9 2024-09-17T04:12:33.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 msgr2=0x7fe11c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 0x7fe11c07b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe128000f60 tx=0x7fe128007a30 comp rx=0 tx=0).stop 2024-09-17T04:12:33.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 msgr2=0x7fe138152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe134000f80 tx=0x7fe134032ec0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 shutdown_connections 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fe11c078b90 0x7fe11c07b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1380d0b40 0x7fe1381f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe138073d50 0x7fe1381f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 --2- 172.21.15.104:0/4163658927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe13806ec30 0x7fe138152770 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 >> 172.21.15.104:0/4163658927 conn(0x7fe1380b2cc0 msgr2=0x7fe13815ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 shutdown_connections 2024-09-17T04:12:33.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.153+0000 7fe13f9f1640 1 -- 172.21.15.104:0/4163658927 wait complete. 2024-09-17T04:12:33.164 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:12:33.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 -- 172.21.15.104:0/108803604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cf4004800 msgr2=0x7f0cf4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 --2- 172.21.15.104:0/108803604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cf4004800 0x7f0cf4004c10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000baf0 tx=0x7f0cf4005830 comp rx=0 tx=0).stop 2024-09-17T04:12:33.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 -- 172.21.15.104:0/108803604 shutdown_connections 2024-09-17T04:12:33.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 --2- 172.21.15.104:0/108803604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0cf4004800 0x7f0cf4004c10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 -- 172.21.15.104:0/108803604 >> 172.21.15.104:0/108803604 conn(0x7f0d0c0d1140 msgr2=0x7f0d0c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 -- 172.21.15.104:0/108803604 shutdown_connections 2024-09-17T04:12:33.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.277+0000 7f0d1234a640 1 -- 172.21.15.104:0/108803604 wait complete. 2024-09-17T04:12:33.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.279+0000 7f0d1234a640 1 Processor -- start 2024-09-17T04:12:33.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.279+0000 7f0d1234a640 1 -- start start 2024-09-17T04:12:33.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cf4004800 0x7f0d0c1f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d0c158f50 0x7f0d0c15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0702e0 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c070160 con 0x7f0cf4004800 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d1234a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c073ea0 con 0x7f0d0c158f50 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d0b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d0b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41522/0 (socket says 172.21.15.104:41522) 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.280+0000 7f0d0b7fe640 1 -- 172.21.15.104:0/1455835639 learned_addr learned my addr 172.21.15.104:0/1455835639 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d108e7640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d0c158f50 0x7f0d0c15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0bfff640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cf4004800 0x7f0d0c1f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 -- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d0c158f50 msgr2=0x7f0d0c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d0c158f50 0x7f0d0c15dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 -- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cf4004800 msgr2=0x7f0d0c1f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cf4004800 0x7f0d0c1f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 -- 172.21.15.104:0/1455835639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c09e690 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d0b7fe640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0d00034040 tx=0x7f0d00032a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00032e20 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0d00004160 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c09e3b0 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000035f0 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.281+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c1f3370 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.282+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c0744c0 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.283+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d0004c060 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.284+0000 7f0d08ff9640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 0x7f0cf807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.284+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7f0d000bbc60 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.284+0000 7f0d0bfff640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 0x7f0cf807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.284+0000 7f0d0bfff640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 0x7f0cf807b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc001850 tx=0x7f0cfc0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.288+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d00040070 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.463+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d0c074f20 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.464+0000 7f0d08ff9640 1 -- 172.21.15.104:0/1455835639 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18998 (secure 0 0 0) 0x7f0d000bb030 con 0x7f0d0c09d9f0 2024-09-17T04:12:33.464 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T04:12:33.464 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"fsid":"6f80e9a4-ab66-4103-911e-380249777ecb","created":"2024-09-17T04:09:14.987385+0000","modified":"2024-09-17T04:10:20.513595+0000","last_up_change":"2024-09-17T04:09:27.903462+0000","last_in_change":"2024-09-17T04:09:18.580292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:09:29.361092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:09:37.546767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:09:38.650344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T04:09:42.362168+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae881500-83ef-4908-9d85-0d96fc0637e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6809","nonce":1713196558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6811","nonce":1713196558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6815","nonce":1713196558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1713196558},{"type":"v1","addr":"172.21.15.104:6813","nonce":1713196558}]},"public_addr":"172.21.15.104:6809/1713196558","cluster_addr":"172.21.15.104:6811/1713196558","heartbeat_back_addr":"172.21.15.104:6815/1713196558","heartbeat_front_addr":"172.21.15.104:6813/1713196558","state":["exists","up"]},{"osd":1,"uuid":"3ed8ba3d-bfa1-4b80-8a7d-65d0fefca9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6801","nonce":2753114801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6803","nonce":2753114801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6807","nonce":2753114801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":2753114801},{"type":"v1","addr":"172.21.15.104:6805","nonce":2753114801}]},"public_addr":"172.21.15.104:6801/2753114801","cluster_addr":"172.21.15.104:6803/2753114801","heartbeat_back_addr":"172.21.15.104:6807/2753114801","heartbeat_front_addr":"172.21.15.104:6805/2753114801","state":["exists","up"]},{"osd":2,"uuid":"5a33277c-6209-45c3-8e11-c60735f21e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6817","nonce":812544585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6819","nonce":812544585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6823","nonce":812544585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":812544585},{"type":"v1","addr":"172.21.15.104:6821","nonce":812544585}]},"public_addr":"172.21.15.104:6817/812544585","cluster_addr":"172.21.15.104:6819/812544585","heartbeat_back_addr":"172.21.15.104:6823/812544585","heartbeat_front_addr":"172.21.15.104:6821/812544585","state":["exists","up"]},{"osd":3,"uuid":"3a478367-3db8-46da-9cd0-157d6338787c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6825","nonce":966144578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6827","nonce":966144578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6831","nonce":966144578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":966144578},{"type":"v1","addr":"172.21.15.104:6829","nonce":966144578}]},"public_addr":"172.21.15.104:6825/966144578","cluster_addr":"172.21.15.104:6827/966144578","heartbeat_back_addr":"172.21.15.104:6831/966144578","heartbeat_front_addr":"172.21.15.104:6829/966144578","state":["exists","up"]},{"osd":4,"uuid":"196ed537-63cd-4e22-859b-ca5235f09c3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6827","nonce":4212015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6829","nonce":4212015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6833","nonce":4212015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4212015},{"type":"v1","addr":"172.21.15.192:6831","nonce":4212015}]},"public_addr":"172.21.15.192:6827/4212015","cluster_addr":"172.21.15.192:6829/4212015","heartbeat_back_addr":"172.21.15.192:6833/4212015","heartbeat_front_addr":"172.21.15.192:6831/4212015","state":["exists","up"]},{"osd":5,"uuid":"0704036c-3630-428b-bdd4-4cd2c6c40451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6811","nonce":4207743842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6813","nonce":4207743842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6817","nonce":4207743842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":4207743842},{"type":"v1","addr":"172.21.15.192:6815","nonce":4207743842}]},"public_addr":"172.21.15.192:6811/4207743842","cluster_addr":"172.21.15.192:6813/4207743842","heartbeat_back_addr":"172.21.15.192:6817/4207743842","heartbeat_front_addr":"172.21.15.192:6815/4207743842","state":["exists","up"]},{"osd":6,"uuid":"6e913243-9de1-451d-a6ce-16ad717f9b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6819","nonce":1564224566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6821","nonce":1564224566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6825","nonce":1564224566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1564224566},{"type":"v1","addr":"172.21.15.192:6823","nonce":1564224566}]},"public_addr":"172.21.15.192:6819/1564224566","cluster_addr":"172.21.15.192:6821/1564224566","heartbeat_back_addr":"172.21.15.192:6825/1564224566","heartbeat_front_addr":"172.21.15.192:6823/1564224566","state":["exists","up"]},{"osd":7,"uuid":"8e444d9d-c1fe-452a-847f-1370732b1bb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6803","nonce":1452307488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6805","nonce":1452307488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6809","nonce":1452307488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1452307488},{"type":"v1","addr":"172.21.15.192:6807","nonce":1452307488}]},"public_addr":"172.21.15.192:6803/1452307488","cluster_addr":"172.21.15.192:6805/1452307488","heartbeat_back_addr":"172.21.15.192:6809/1452307488","heartbeat_front_addr":"172.21.15.192:6807/1452307488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.613036+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.447376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.113817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.726618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.537834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:24.899481+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.191771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:09:25.374485+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:12:33.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 msgr2=0x7f0cf807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 0x7f0cf807b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc001850 tx=0x7f0cfc0067a0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 msgr2=0x7f0d0c158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0d00034040 tx=0x7f0d00032a30 comp rx=0 tx=0).stop 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 shutdown_connections 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0cf8078bc0 0x7f0cf807b0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d0c158f50 0x7f0d0c15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0d0c09d9f0 0x7f0d0c158a10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 --2- 172.21.15.104:0/1455835639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cf4004800 0x7f0d0c1f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 >> 172.21.15.104:0/1455835639 conn(0x7f0d0c0d1140 msgr2=0x7f0d0c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.466+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 shutdown_connections 2024-09-17T04:12:33.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.467+0000 7f0d1234a640 1 -- 172.21.15.104:0/1455835639 wait complete. 2024-09-17T04:12:33.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T04:12:33.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 -- 172.21.15.104:0/823261545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 msgr2=0x7fbc1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/823261545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc1c004800 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800bb10 tx=0x7fbc1c005830 comp rx=0 tx=0).stop 2024-09-17T04:12:33.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc33fff640 1 -- 172.21.15.104:0/823261545 reap_dead start 2024-09-17T04:12:33.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 -- 172.21.15.104:0/823261545 shutdown_connections 2024-09-17T04:12:33.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 -- 172.21.15.104:0/823261545 >> 172.21.15.104:0/823261545 conn(0x7fbc3409d830 msgr2=0x7fbc340b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 -- 172.21.15.104:0/823261545 shutdown_connections 2024-09-17T04:12:33.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.591+0000 7fbc39e9b640 1 -- 172.21.15.104:0/823261545 wait complete. 2024-09-17T04:12:33.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.593+0000 7fbc39e9b640 1 Processor -- start 2024-09-17T04:12:33.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.593+0000 7fbc39e9b640 1 -- start start 2024-09-17T04:12:33.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc340cde20 0x7fbc340ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3406e420 0x7fbc3406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbc340d02f0 con 0x7fbc1c004080 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc340d0170 con 0x7fbc3406e420 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc39e9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbc340d0470 con 0x7fbc340cde20 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.594+0000 7fbc337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41532/0 (socket says 172.21.15.104:41532) 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 -- 172.21.15.104:0/295572472 learned_addr learned my addr 172.21.15.104:0/295572472 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc32ffd640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc340cde20 0x7fbc340ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 -- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc340cde20 msgr2=0x7fbc340ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc340cde20 0x7fbc340ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 -- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3406e420 msgr2=0x7fbc3406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc33fff640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3406e420 0x7fbc3406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3406e420 0x7fbc3406e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 -- 172.21.15.104:0/295572472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc341f63e0 con 0x7fbc1c004080 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc337fe640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc24010c40 tx=0x7fbc2400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24003b70 con 0x7fbc1c004080 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbc24003e20 con 0x7fbc1c004080 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3406ed70 con 0x7fbc1c004080 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24004260 con 0x7fbc1c004080 2024-09-17T04:12:33.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.595+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3406d460 con 0x7fbc1c004080 2024-09-17T04:12:33.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.596+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc340d0be0 con 0x7fbc1c004080 2024-09-17T04:12:33.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.597+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc2401a030 con 0x7fbc1c004080 2024-09-17T04:12:33.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.597+0000 7fbc1bfff640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 0x7fbc2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.598+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6735+0+0 (secure 0 0 0) 0x7fbc2409c0d0 con 0x7fbc1c004080 2024-09-17T04:12:33.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.598+0000 7fbc32ffd640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 0x7fbc2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.598+0000 7fbc32ffd640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 0x7fbc2007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc28036000 tx=0x7fbc28004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.602+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc3406ed70 con 0x7fbc1c004080 2024-09-17T04:12:33.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.810+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbc340762a0 con 0x7fbc1c004080 2024-09-17T04:12:33.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.813+0000 7fbc1bfff640 1 -- 172.21.15.104:0/295572472 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fbc341f63e0 con 0x7fbc1c004080 2024-09-17T04:12:33.813 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.816+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 msgr2=0x7fbc2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.816+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 0x7fbc2007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc28036000 tx=0x7fbc28004730 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.816+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 msgr2=0x7fbc341f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.816+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc24010c40 tx=0x7fbc2400e6c0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 shutdown_connections 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fbc20078b90 0x7fbc2007b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc3406e420 0x7fbc3406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc340cde20 0x7fbc340ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 --2- 172.21.15.104:0/295572472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc1c004080 0x7fbc341f5ea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 >> 172.21.15.104:0/295572472 conn(0x7fbc3409d830 msgr2=0x7fbc340b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 shutdown_connections 2024-09-17T04:12:33.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.817+0000 7fbc39e9b640 1 -- 172.21.15.104:0/295572472 wait complete. 2024-09-17T04:12:33.828 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T04:12:33.884 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T04:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 -- 172.21.15.104:0/816381998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0ccc40 msgr2=0x7f0f9c15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 --2- 172.21.15.104:0/816381998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0ccc40 0x7f0f9c15ca90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c005fd0 tx=0x7f0f8c02a820 comp rx=0 tx=0).stop 2024-09-17T04:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 -- 172.21.15.104:0/816381998 shutdown_connections 2024-09-17T04:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 --2- 172.21.15.104:0/816381998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0d0d80 0x7f0f9c0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 --2- 172.21.15.104:0/816381998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0ccc40 0x7f0f9c15ca90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 -- 172.21.15.104:0/816381998 >> 172.21.15.104:0/816381998 conn(0x7f0f9c0b46e0 msgr2=0x7f0f9c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 -- 172.21.15.104:0/816381998 shutdown_connections 2024-09-17T04:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.944+0000 7f0fa224a640 1 -- 172.21.15.104:0/816381998 wait complete. 2024-09-17T04:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.946+0000 7f0fa224a640 1 Processor -- start 2024-09-17T04:12:33.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.946+0000 7f0fa224a640 1 -- start start 2024-09-17T04:12:33.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 0x7f0f9c1f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0aaac0 0x7f0f9c1f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c0b66a0 con 0x7f0f9c0cd440 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c0b6520 con 0x7f0f9c0aaac0 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0fa224a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9c0b6820 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0f9affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0f9affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41540/0 (socket says 172.21.15.104:41540) 2024-09-17T04:12:33.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0f9affd640 1 -- 172.21.15.104:0/690107676 learned_addr learned my addr 172.21.15.104:0/690107676 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:33.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0f9b7fe640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 0x7f0f9c1f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.947+0000 7f0f9bfff640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0aaac0 0x7f0f9c1f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 -- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0aaac0 msgr2=0x7f0f9c1f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0aaac0 0x7f0f9c1f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 -- 172.21.15.104:0/690107676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 msgr2=0x7f0f9c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 -- 172.21.15.104:0/690107676 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c15e430 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9affd640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f9b7fe640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 0x7f0f9c1f64a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009000 tx=0x7f0f8c032c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c037040 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0f8c004040 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c1f6e10 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0042d0 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.948+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1f3050 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.949+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c0b6e00 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.950+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f8c044020 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.950+0000 7f0f83fff640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 0x7f0f8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:33.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.950+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7f0f8c0bb580 con 0x7f0f9c0ccc40 2024-09-17T04:12:33.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.951+0000 7f0f9affd640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 0x7f0f8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:33.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.951+0000 7f0f9affd640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 0x7f0f8807b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001ba0 tx=0x7f0f90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:33.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:33.955+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f8c04b020 con 0x7f0f9c0ccc40 2024-09-17T04:12:34.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.164+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0f9c0b1ec0 con 0x7f0f9c0ccc40 2024-09-17T04:12:34.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.848+0000 7f0f83fff640 1 -- 172.21.15.104:0/690107676 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f0f8c082fa0 con 0x7f0f9c0ccc40 2024-09-17T04:12:34.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 msgr2=0x7f0f8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:34.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 0x7f0f8807b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001ba0 tx=0x7f0f90009040 comp rx=0 tx=0).stop 2024-09-17T04:12:34.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 msgr2=0x7f0f9c1f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:34.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 0x7f0f9c1f64a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009000 tx=0x7f0f8c032c80 comp rx=0 tx=0).stop 2024-09-17T04:12:34.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 shutdown_connections 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f0f88078bc0 0x7f0f8807b0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f9c0aaac0 0x7f0f9c1f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f9c0cd440 0x7f0f9c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 --2- 172.21.15.104:0/690107676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f9c0ccc40 0x7f0f9c1f64a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 >> 172.21.15.104:0/690107676 conn(0x7f0f9c0b46e0 msgr2=0x7f0f9c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 shutdown_connections 2024-09-17T04:12:34.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.850+0000 7f0fa224a640 1 -- 172.21.15.104:0/690107676 wait complete. 2024-09-17T04:12:34.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 -- 172.21.15.104:0/4245620123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00b7b60 msgr2=0x7f16d00b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 --2- 172.21.15.104:0/4245620123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00b7b60 0x7f16d00b7f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f16d008d490 tx=0x7f16c002a560 comp rx=0 tx=0).stop 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 -- 172.21.15.104:0/4245620123 shutdown_connections 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 --2- 172.21.15.104:0/4245620123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 0x7f16d00cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 --2- 172.21.15.104:0/4245620123 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00b7b60 0x7f16d00b7f70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 --2- 172.21.15.104:0/4245620123 >> v2:172.21.15.192:3300/0 conn(0x7f16d00d0460 0x7f16d0161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.980+0000 7f16d75c3640 1 -- 172.21.15.104:0/4245620123 >> 172.21.15.104:0/4245620123 conn(0x7f16d00d4510 msgr2=0x7f16d00d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.981+0000 7f16d75c3640 1 -- 172.21.15.104:0/4245620123 shutdown_connections 2024-09-17T04:12:34.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.981+0000 7f16d75c3640 1 -- 172.21.15.104:0/4245620123 wait complete. 2024-09-17T04:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.982+0000 7f16d75c3640 1 Processor -- start 2024-09-17T04:12:34.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.982+0000 7f16d75c3640 1 -- start start 2024-09-17T04:12:34.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00b7b60 0x7f16d01f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 0x7f16d01f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f16d00b6380 con 0x7f16d00d0460 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16d00b6200 con 0x7f16d00b7b60 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16d00b6500 con 0x7f16d00cf200 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41570/0 (socket says 172.21.15.104:41570) 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 -- 172.21.15.104:0/3485477139 learned_addr learned my addr 172.21.15.104:0/3485477139 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d4b5e640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 0x7f16d01f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d535f640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00b7b60 0x7f16d01f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 -- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 msgr2=0x7f16d01f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 0x7f16d01f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 -- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00b7b60 msgr2=0x7f16d01f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00b7b60 0x7f16d01f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 -- 172.21.15.104:0/3485477139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d0150390 con 0x7f16d00d0460 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d5b60640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e990 tx=0x7f16c800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8004d20 con 0x7f16d00d0460 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f16c800caa0 con 0x7f16d00d0460 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.984+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d014f5d0 con 0x7f16d00d0460 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.985+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8005020 con 0x7f16d00d0460 2024-09-17T04:12:34.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.985+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d014fb90 con 0x7f16d00d0460 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.986+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d00cf610 con 0x7f16d00d0460 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.986+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16c80051c0 con 0x7f16d00d0460 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.987+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 0x7f16b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.987+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6821+0+0 (secure 0 0 0) 0x7f16c809b870 con 0x7f16d00d0460 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.987+0000 7f16d535f640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 0x7f16b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:34.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.988+0000 7f16d535f640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 0x7f16b407b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bb50 tx=0x7f16cc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:34.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:34.991+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16c8016030 con 0x7f16d00d0460 2024-09-17T04:12:35.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.169+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16d01f9600 con 0x7f16d00d0460 2024-09-17T04:12:35.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:35.706 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.853+0000 7f16c5ffb640 1 -- 172.21.15.104:0/3485477139 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f16c8063290 con 0x7f16d00d0460 2024-09-17T04:12:35.853 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T04:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.856+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 msgr2=0x7f16b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.856+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 0x7f16b407b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bb50 tx=0x7f16cc00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 msgr2=0x7f16d00b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e990 tx=0x7f16c800ee50 comp rx=0 tx=0).stop 2024-09-17T04:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 shutdown_connections 2024-09-17T04:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f16b4078bc0 0x7f16b407b0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16d00d0460 0x7f16d00b9570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00cf200 0x7f16d01f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 --2- 172.21.15.104:0/3485477139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00b7b60 0x7f16d01f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 >> 172.21.15.104:0/3485477139 conn(0x7f16d00d4510 msgr2=0x7f16d00b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 shutdown_connections 2024-09-17T04:12:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.857+0000 7f16d75c3640 1 -- 172.21.15.104:0/3485477139 wait complete. 2024-09-17T04:12:35.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 -- 172.21.15.104:0/1138908135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 msgr2=0x7fec94161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 --2- 172.21.15.104:0/1138908135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec94161ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec84009830 tx=0x7fec8402a510 comp rx=0 tx=0).stop 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 -- 172.21.15.104:0/1138908135 shutdown_connections 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 --2- 172.21.15.104:0/1138908135 >> v2:172.21.15.192:3300/0 conn(0x7fec940cf910 0x7fec940b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 --2- 172.21.15.104:0/1138908135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec94161ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 -- 172.21.15.104:0/1138908135 >> 172.21.15.104:0/1138908135 conn(0x7fec940d4510 msgr2=0x7fec940d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 -- 172.21.15.104:0/1138908135 shutdown_connections 2024-09-17T04:12:35.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.987+0000 7fec9a958640 1 -- 172.21.15.104:0/1138908135 wait complete. 2024-09-17T04:12:35.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.988+0000 7fec9a958640 1 Processor -- start 2024-09-17T04:12:35.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.989+0000 7fec9a958640 1 -- start start 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec940cf910 0x7fec9414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec941f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fec94162b20 con 0x7fec940b7b60 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec941629a0 con 0x7fec940cf910 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec9a958640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec94162ca0 con 0x7fec940d0460 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41578/0 (socket says 172.21.15.104:41578) 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 -- 172.21.15.104:0/17141536 learned_addr learned my addr 172.21.15.104:0/17141536 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec98ef5640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec941f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:35.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec937fe640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec940cf910 0x7fec9414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 -- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 msgr2=0x7fec941f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec941f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 -- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec940cf910 msgr2=0x7fec9414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec940cf910 0x7fec9414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.990+0000 7fec93fff640 1 -- 172.21.15.104:0/17141536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec940b6850 con 0x7fec940b7b60 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec93fff640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec84009920 tx=0x7fec840052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84005c90 con 0x7fec940b7b60 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fec84031d70 con 0x7fec940b7b60 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec941f9c90 con 0x7fec940b7b60 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84004990 con 0x7fec940b7b60 2024-09-17T04:12:35.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.991+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9414ccc0 con 0x7fec940b7b60 2024-09-17T04:12:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.992+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec94163290 con 0x7fec940b7b60 2024-09-17T04:12:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.992+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec84031770 con 0x7fec940b7b60 2024-09-17T04:12:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.993+0000 7fec90ff9640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 0x7fec8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.993+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6383+0+0 (secure 0 0 0) 0x7fec840bc190 con 0x7fec940b7b60 2024-09-17T04:12:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.993+0000 7fec937fe640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 0x7fec8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:35.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.994+0000 7fec937fe640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 0x7fec8007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec88007fd0 tx=0x7fec88001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:35.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:35.998+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec8403f030 con 0x7fec940b7b60 2024-09-17T04:12:36.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.171+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec940cfe20 con 0x7fec940b7b60 2024-09-17T04:12:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.859+0000 7fec90ff9640 1 -- 172.21.15.104:0/17141536 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7fec84084330 con 0x7fec940b7b60 2024-09-17T04:12:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 msgr2=0x7fec8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 0x7fec8007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec88007fd0 tx=0x7fec88001370 comp rx=0 tx=0).stop 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 msgr2=0x7fec94155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec84009920 tx=0x7fec840052f0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 shutdown_connections 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7fec80078b90 0x7fec8007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec940cf910 0x7fec9414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec940d0460 0x7fec941f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 --2- 172.21.15.104:0/17141536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec940b7b60 0x7fec94155f40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 >> 172.21.15.104:0/17141536 conn(0x7fec940d4510 msgr2=0x7fec940b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:36.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 shutdown_connections 2024-09-17T04:12:36.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.863+0000 7fec9a958640 1 -- 172.21.15.104:0/17141536 wait complete. 2024-09-17T04:12:36.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 -- 172.21.15.104:0/1818257189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c8004800 msgr2=0x7f40c8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 --2- 172.21.15.104:0/1818257189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c8004800 0x7f40c8004c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009b50 tx=0x7f40c8005830 comp rx=0 tx=0).stop 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 -- 172.21.15.104:0/1818257189 shutdown_connections 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 --2- 172.21.15.104:0/1818257189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c8004800 0x7f40c8004c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 -- 172.21.15.104:0/1818257189 >> 172.21.15.104:0/1818257189 conn(0x7f40dc0741a0 msgr2=0x7f40dc0b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 -- 172.21.15.104:0/1818257189 shutdown_connections 2024-09-17T04:12:36.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.995+0000 7f40e2263640 1 -- 172.21.15.104:0/1818257189 wait complete. 2024-09-17T04:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.997+0000 7f40e2263640 1 Processor -- start 2024-09-17T04:12:36.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.997+0000 7f40e2263640 1 -- start start 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 0x7f40dc0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40dc146c60 0x7f40dc1f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc0d10e0 con 0x7f40dc14ff80 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc0d0f60 con 0x7f40c8004800 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e2263640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f40dc0d1260 con 0x7f40dc146c60 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:36.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39844/0 (socket says 172.21.15.104:39844) 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 -- 172.21.15.104:0/3948241407 learned_addr learned my addr 172.21.15.104:0/3948241407 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40dbfff640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 0x7f40dc0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40d3fff640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40dc146c60 0x7f40dc1f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 -- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40dc146c60 msgr2=0x7f40dc1f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40dc146c60 0x7f40dc1f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 -- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 msgr2=0x7f40dc0b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 0x7f40dc0b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40e0800640 1 -- 172.21.15.104:0/3948241407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc1f61c0 con 0x7f40dc14ff80 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.998+0000 7f40dbfff640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 0x7f40dc0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40e0800640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f40dc073f00 tx=0x7f40d40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011870 con 0x7f40dc14ff80 2024-09-17T04:12:37.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f40d4017070 con 0x7f40dc14ff80 2024-09-17T04:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc1f5ee0 con 0x7f40dc14ff80 2024-09-17T04:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4011da0 con 0x7f40dc14ff80 2024-09-17T04:12:37.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:36.999+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc0b0000 con 0x7f40dc14ff80 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.000+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc1f5c30 con 0x7f40dc14ff80 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.000+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40d401c460 con 0x7f40dc14ff80 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.001+0000 7f40d97fa640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 0x7f40bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.001+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7f40d409b5e0 con 0x7f40dc14ff80 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.001+0000 7f40dbfff640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 0x7f40bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:12:37.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.002+0000 7f40dbfff640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 0x7f40bc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0018a0 tx=0x7f40cc001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:12:37.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.005+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40d4063990 con 0x7f40dc14ff80 2024-09-17T04:12:37.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.179+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40dc0d1810 con 0x7f40dc14ff80 2024-09-17T04:12:37.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.864+0000 7f40d97fa640 1 -- 172.21.15.104:0/3948241407 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f40d4063290 con 0x7f40dc14ff80 2024-09-17T04:12:37.864 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data_ec' removed 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 msgr2=0x7f40bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 0x7f40bc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0018a0 tx=0x7f40cc001df0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 msgr2=0x7f40dc150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f40dc073f00 tx=0x7f40d40019b0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 shutdown_connections 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:6800/330081550,v1:172.21.15.192:6801/330081550] conn(0x7f40bc078b90 0x7f40bc07b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40dc14ff80 0x7f40dc150390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40dc146c60 0x7f40dc1f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 --2- 172.21.15.104:0/3948241407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c8004800 0x7f40dc0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:12:37.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 >> 172.21.15.104:0/3948241407 conn(0x7f40dc0741a0 msgr2=0x7f40dc0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:12:37.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 shutdown_connections 2024-09-17T04:12:37.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T04:12:37.867+0000 7f40e2263640 1 -- 172.21.15.104:0/3948241407 wait complete. 2024-09-17T04:12:37.880 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T04:12:37.881 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T04:12:37.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:37.890 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T04:12:37.890 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T04:12:37.890 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:37.939 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T04:12:37.939 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T04:12:37.940 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:37.950 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T04:12:37.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T04:12:37.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.006 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T04:12:38.006 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T04:12:38.006 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T04:12:38.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.037 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T04:12:38.037 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T04:12:38.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.108 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T04:12:38.108 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T04:12:38.108 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.179 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T04:12:38.179 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T04:12:38.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.250 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T04:12:38.250 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T04:12:38.250 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.291 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T04:12:38.291 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T04:12:38.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.337 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T04:12:38.337 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T04:12:38.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.377 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T04:12:38.378 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T04:12:38.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.450 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T04:12:38.451 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T04:12:38.451 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T04:12:38.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.478 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T04:12:38.478 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T04:12:38.478 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.520 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T04:12:38.521 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T04:12:38.521 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T04:12:38.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.532 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T04:12:38.532 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T04:12:38.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.573 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T04:12:38.574 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T04:12:38.574 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:12:38.626 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T04:12:38.626 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T04:12:38.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T04:12:38.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:12:38.660 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T04:12:38.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:12:38.970 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T04:12:39.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:12:39.057 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T04:12:39.107 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:12:39.107 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T04:12:39.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:12:39.175 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T04:12:39.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:12:39.320 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T04:12:39.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:12:39.448 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T04:12:39.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:12:39.506 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T04:12:39.563 INFO:tasks.ceph:Archiving mon data... 2024-09-17T04:12:39.565 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/data/mon.a.tgz 2024-09-17T04:12:39.565 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-17T04:12:39.581 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.XdPE7plv26 2024-09-17T04:12:39.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XdPE7plv26 2024-09-17T04:12:39.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.XdPE7plv26 2024-09-17T04:12:39.801 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.XdPE7plv26 is 304KB 2024-09-17T04:12:39.897 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.XdPE7plv26 2024-09-17T04:12:39.912 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/data/mon.b.tgz 2024-09-17T04:12:39.912 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T04:12:39.930 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.vqmKij8hqa 2024-09-17T04:12:39.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vqmKij8hqa 2024-09-17T04:12:40.086 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.vqmKij8hqa 2024-09-17T04:12:40.170 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.vqmKij8hqa is 411KB 2024-09-17T04:12:40.265 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.vqmKij8hqa 2024-09-17T04:12:40.280 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/data/mon.c.tgz 2024-09-17T04:12:40.280 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T04:12:40.334 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.KocSI9VyN4 2024-09-17T04:12:40.334 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.KocSI9VyN4 2024-09-17T04:12:40.474 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.KocSI9VyN4 2024-09-17T04:12:40.557 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.KocSI9VyN4 is 411KB 2024-09-17T04:12:40.652 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.KocSI9VyN4 2024-09-17T04:12:40.667 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T04:12:40.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T04:12:40.669 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T04:12:40.750 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T04:12:40.786 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T04:12:40.786 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T04:12:40.788 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi104/crash 2024-09-17T04:12:40.788 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T04:12:40.814 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi192/crash 2024-09-17T04:12:40.815 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T04:12:40.850 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T04:12:40.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:40.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:40.943 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:40.967 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T04:12:40.991 INFO:tasks.ceph:Compressing logs... 2024-09-17T04:12:40.991 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:12:41.010 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:12:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T04:12:41.032 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57227.log 2024-09-17T04:12:41.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58568.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36424.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36544.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36424.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose 86.7% -- -- replaced with /var/log/ceph/ceph-client.admin.36424.log.gz /var/log/ceph/ceph-client.admin.36384.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36544.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36544.log.gz 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36384.log.gz 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T04:12:41.078 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36464.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42662.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.audit.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.42662.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.1.42662.log.gz /var/log/ceph/ceph-client.admin.36584.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36304.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36584.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36584.log.gz 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36304.log: /var/log/ceph/ceph-mon.c.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36304.log.gz 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T04:12:41.079 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.36344.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-09-17T04:12:41.080 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43060.log 2024-09-17T04:12:41.095 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.3.43060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43060.log.gz 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37145.log 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57227.log.gz 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37103.log 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58568.log.gz 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-09-17T04:12:41.100 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37145.log: /var/log/ceph/ceph-client.admin.37103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58962.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37145.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37103.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45326.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45326.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58962.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58328.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45326.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46943.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58370.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58328.log.gz 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58076.log 2024-09-17T04:12:41.101 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46943.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58370.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30490.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58370.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58244.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.30490.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.58076.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30490.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58244.log.gz/var/log/ceph/ceph-client.admin.57337.log: 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45530.log 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2024-09-17T04:12:41.102 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45530.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44986.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.44986.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44986.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36621.log 2024-09-17T04:12:41.103 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57782.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45572.log: /var/log/ceph/ceph-client.admin.36621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45614.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.36621.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57456.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57782.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45614.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58286.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57456.log: /var/log/ceph/ceph-client.admin.43708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57456.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57656.log 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58286.log.gz 2024-09-17T04:12:41.104 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57656.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57824.log 92.5% 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45333.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36677.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57824.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44994.log: /var/log/ceph/ceph-client.admin.36677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37810.log 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-09-17T04:12:41.105 INFO:teuthology.orchestra.run.smithi104.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.36677.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43202.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58118.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37810.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58160.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58776.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58118.log: /var/log/ceph/ceph-client.admin.58160.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.58118.log.gz --verbose -- 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.44650.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58160.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58412.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58776.log.gz 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2024-09-17T04:12:41.106 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44650.log: /var/log/ceph/ceph-client.admin.58412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44650.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58412.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58034.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37056.log: /var/log/ceph/ceph-client.admin.44480.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58034.log: /var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58034.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-09-17T04:12:41.107 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43034.log: /var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57866.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46767.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57866.log: /var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42650.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57866.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.2.46767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46767.log.gz 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57614.log 2024-09-17T04:12:41.108 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58734.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42412.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42650.log.gz 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57614.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57614.log.gz 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44659.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58734.log.gz 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.44659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44659.log.gz 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gzgzip 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2024-09-17T04:12:41.109 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37519.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43118.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45332.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37144.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37140.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43118.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58202.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43118.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58920.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37144.log: /var/log/ceph/ceph-client.admin.58202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37144.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58202.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58920.log.gz 2024-09-17T04:12:41.110 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58860.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44993.log: /var/log/ceph/ceph-client.admin.44018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57740.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58860.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58818.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57740.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57698.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45331.log: /var/log/ceph/ceph-client.admin.58818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58818.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57698.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57698.log.gz 2024-09-17T04:12:41.111 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45657.log: /var/log/ceph/ceph-mon.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37138.log: /var/log/ceph/ceph-client.admin.45328.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.43883.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42864.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43883.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58454.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-09-17T04:12:41.112 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.42864.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58526.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58454.log: /var/log/ceph/ceph-client.admin.44186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58608.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58454.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58526.log: gzip -5 87.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz /var/log/ceph/ceph-client.admin.57950.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58526.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45334.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58608.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57950.log: /var/log/ceph/ceph-client.admin.45334.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57950.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37147.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5%/var/log/ceph/ceph-osd.2.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.45334.log.gz 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37147.log: gzip -5 --verbose -- 85.6% /var/log/ceph/ceph-client.admin.44312.log 2024-09-17T04:12:41.113 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37147.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43160.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44270.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44312.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43160.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43160.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44270.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36916.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44990.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45783.log 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36916.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44990.log: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44990.log.gz 2024-09-17T04:12:41.114 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42692.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6%/var/log/ceph/ceph-client.admin.42692.log: -- replaced with /var/log/ceph/ceph-client.admin.45783.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44995.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42692.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46901.log: /var/log/ceph/ceph-client.admin.44995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44649.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44995.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45741.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36593.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42908.log: /var/log/ceph/ceph-client.admin.45741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 92.9%/var/log/ceph/ceph-client.admin.36593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-09-17T04:12:41.115 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45741.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 76.0% -- replaced with /var/log/ceph/ceph-client.admin.36593.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36649.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45825.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36536.log: /var/log/ceph/ceph-client.admin.36649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44396.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36649.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37157.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44396.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45825.log.gz 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58650.log 2024-09-17T04:12:41.116 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37157.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58650.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58692.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57992.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58692.log.gz 2024-09-17T04:12:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.57992.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57414.log 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44354.log 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57414.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46310.log 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44354.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T04:12:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.46310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46310.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36877.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37720.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36877.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44228.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57908.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37720.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44228.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44228.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45699.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57908.log.gz 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37129.log 2024-09-17T04:12:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45699.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37129.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37129.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42822.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.42331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37479.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42822.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42822.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37479.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44658.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-09-17T04:12:41.120 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42736.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-09-17T04:12:41.121 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T04:12:41.165 INFO:teuthology.orchestra.run.smithi192.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T04:12:41.168 INFO:teuthology.orchestra.run.smithi192.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T04:12:41.228 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T04:12:41.895 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T04:12:42.025 INFO:teuthology.orchestra.run.smithi104.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T04:12:42.116 INFO:teuthology.orchestra.run.smithi104.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T04:12:42.164 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T04:12:42.407 INFO:teuthology.orchestra.run.smithi192.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T04:12:42.516 INFO:teuthology.orchestra.run.smithi192.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T04:12:42.931 INFO:teuthology.orchestra.run.smithi192.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T04:12:43.075 INFO:teuthology.orchestra.run.smithi104.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T04:12:43.077 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T04:12:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m2.055s 2024-09-17T04:12:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m4.966s 2024-09-17T04:12:43.077 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.268s 2024-09-17T04:12:50.548 INFO:teuthology.orchestra.run.smithi192.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T04:12:50.550 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-17T04:12:50.550 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m9.497s 2024-09-17T04:12:50.550 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m15.024s 2024-09-17T04:12:50.550 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.469s 2024-09-17T04:12:50.551 INFO:tasks.ceph:Archiving logs... 2024-09-17T04:12:50.551 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi104/log 2024-09-17T04:12:50.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:12:51.458 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi192/log 2024-09-17T04:12:51.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:12:53.680 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T04:12:53.690 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T04:12:53.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:12:53.693 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:12:53.766 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T04:12:53.775 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T04:12:53.775 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:12:53.778 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:12:53.793 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:12:53.794 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:12:53.797 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:12:53.798 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-17T04:12:53.798 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +1689us[+1698us] +/- 39ms 2024-09-17T04:12:53.798 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 +127us[ +136us] +/- 75ms 2024-09-17T04:12:53.798 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -3120us[-3120us] +/- 66ms 2024-09-17T04:12:53.798 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +1693us[+1710us] +/- 39ms 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 +121us[ +121us] +/- 75ms 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -3128us[-3112us] +/- 66ms 2024-09-17T04:12:53.799 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:12:53.800 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T04:12:53.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T04:12:53.810 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T04:12:53.819 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:12:53.911 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:12:53.979 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:12:54.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:12:54.010 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:12:54.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:12:54.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T04:12:54.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T04:12:54.057 INFO:teuthology.task.internal:Duration was 583.903303 seconds 2024-09-17T04:12:54.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T04:12:54.066 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T04:12:54.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:12:54.069 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:12:54.106 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:12:54.120 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:12:54.420 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T04:12:54.420 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T04:12:54.420 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:12:54.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T04:12:54.441 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:12:54.488 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T04:12:54.488 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:12:54.491 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:12:54.555 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T04:12:54.555 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:12:54.558 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:12:54.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T04:12:54.707 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T04:12:54.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:12:54.732 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:12:54.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T04:12:54.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:12:54.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:12:54.796 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-09-17T04:12:54.821 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-17T04:12:54.835 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:12:54.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:12:54.864 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:12:54.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:12:54.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T04:12:54.899 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T04:12:54.900 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi104 2024-09-17T04:12:54.900 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:12:54.939 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908504/remote/smithi192 2024-09-17T04:12:54.939 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:12:54.972 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T04:12:54.972 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:12:54.976 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:12:55.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T04:12:55.044 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T04:12:55.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T04:12:55.072 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T04:12:55.073 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:12:55.076 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:12:55.088 INFO:teuthology.orchestra.run.smithi104.stdout: 266054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 04:12 /home/ubuntu/cephtest 2024-09-17T04:12:55.091 INFO:teuthology.orchestra.run.smithi192.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 04:12 /home/ubuntu/cephtest 2024-09-17T04:12:55.092 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T04:12:55.103 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T04:12:55.127 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries} duration: 583.9033033847809 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T04:12:55.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:12:55.205 INFO:teuthology.run:pass